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' I. INTRODUCTIOJJ 

The Itork TWaln Teacher Internship Program is in dts second year of operation as a 
Montgomery County Public Schools program for the 'preparation of personnel to 
teach adolescen'ts with special needs The Internship Program was preceded by a - 
Staff Dtevelopment Institute which trained the Btaff oi Mark Twain School in the 
skills and techniques needed to work with emotionally handicapped adolescents; it 
served as the fitst step In establishing Mark Twain Schopj: as a staff development 
center for the teaching of adolescents with emotional and learning problems. 
Supported by a special innovative 'project planning grant from the U.S. Office of 
Education, Bureau of Education for the Handicapped, the six-month Institute 
developed the basic tefacher training curriculum and format on which the Intern- 
ship Program has been based. A report on the Mark Twain Staff Development Insti- * 
IRide /was submitted to the' granting authority iu 1972* 

the Mark Twain Programs, includlig Mark Twain School and its satellite programs in 
other public schools, comprise the setting for the Mark Twain Teacher Intemsjiip 
Program. Mark Twain School provides an intensive short-term program for adoles- 
cents of at least aVerage Intellectuar: potential who are having learning and 
emotional difficulties. The Mark Twain School-Based Programs provide appropriate 
supportive educational services to students in cKeir reguliar .public school set- 
tings* TKe Hark TwaJji Teacher Internship Program, which intertwines staff develop- 
ment wJ^K service to students, serves as a public school alternative to graduate,, 
teacher training. Selected by Abt Associates, Inc., of Cambridge, Massachusetts, 
as one of 17 innovative training projects for casfe study during the 1972-73 school 
year, the Mark Twain Teacher Internship Program subsequently was included in "A 
Protect to Assess, Document, and Spread Exemplary Programs in Education of the ^ 
^ Handicapped*' for the 3ufeau gf Education for the Handicapped, reported in Volume 
IV, Manp ower Development Case Studies , AAl Report No. 73-85, June X973. 

The precent report focuses priinarily oa describing and evaluating the ten-month 
Mark Twain Teacher Internship Tfogram which began in August, 1972, and ended in 
June, 1973. Sog- rov-' ^ of the 1971-72 Mark Twain Staff Development Institute 
and the preparatio,* for Jie 1973-74 Internship Program will Ije included. Progress 
toward the basix goal of developing and Implementing a public school training. ^ 
program for personnel to teach* adolescents with emotional and learning difficul- 
ties will be examined and assessed. Section I presents the history of the program, 
its goals and objectives, and the context within which it operates. Section II ^ \ 
provides an overview of program operations. Progress toward attainment of progr^m^ \ 
goal^p with recommendations for the future are presented and discussed in Secti^^n 
III. Section IV summarizes the report. ' * 

HISTORICAL BACKGROUND , ^ ' n * 

Like other school siystems across the nation, Montgomery County Public Schools has 
bScome increasingly concerned aboat students who are unable to succeed in. academic 
tasks and human relationships aind about^ thje shortage of facilities and >^t rained 
personnel to, work with them. Many of thesd students are adolescents who are over- 
whelmed ^y failure. They fail to achieve academically, to 6xercise proper judg- 
ment, to organize their thoughts and ^ergies for constructive activities, and to 
behave In socially .acceptable ways. These continuing failures isolate them from 
, their peers and alienate them from adults. Without resolution of these problems, 
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a large number -these young people will enter the conmunity with poor vocational 
and social preparation and with strong feelings of inadequacy and hostility. Many 
withdraw from work or social demands and become a' burden on the community. 

In order to prevent this wa6te of hu^ resources,, a 1961 Youth Services Advisory 
Committee beg^n considering programs which would better serve the students of 
Montgomery County with special needs. To promote the. development of strategies 
and the delineation of services necessary to Implemerft a comprehensive, county- 
wide supplementary education program, a grant 'was awarded to Montgomeiry County 
Public Schools in 1966 under the Elementary and Secondary Education Act to study 
the feasibility of designing and operating a model demonstration school for chil- 
dren whose special needs were not being m;et by existing school programs. One of 
two recommendations with highest priority was the development of multilevel school 
programs for the "evaluation, education, and adjustment of emotionally handi&pped 
adolescent boys and girls in three types of settings." These were to incij-ude a 
"year-round day program in a special school for seriously handicapped adolescents, 
programs in selected junior and senior high schools for students able to function 
with appropriate support in the* regular school environment, and a satellite school 
for mildly retarded adolescents who •are CTotionally handicapped" (MCPS, 1967). 

Implementation "of -the first part of this recommendation was approved by Montgomerj^ 
County Public Schools, and the appointment of the supervisory staff of Mark Twain 
School was completed by September, 1970. At the same time, the second'part of 'the 
recommendation was Implemented %^en M&rk Twain School- Based Programs were launched 
on a pilot basis in three junior high schools. The Mark Twain Programs serve as a 
meai^s of fulfilling a commitment toward implementatsripn of the Continuum of Educa- 
tionfil Services, shown in A1>pendlx^A. The continuum concept is a plan to provide 
educational services to all children according to the degree of program speciali- 
zation aeedel to meet the severity of the problem. Implementation of contipuum 
programmiug requires the preparation of additional parsoxmel with special training 
at all levels of • educational service. From the earliest planning for^Mark Twain 
School i ita role as a teacher education center was recognizeif and documented in 
its baeic rbjeccives.< Toward this end, in April, 1971^^ the Montgomery County 
Public Schools recHived a grant under Title IV of PublifrLaw 91-230, Educati6n of 
the Handicapped Act, to supplement funding of the Mark TVain Staff Develoipment 
IiiStitute. Following that grant period (July 1, 1970, to June 30, 1972), a two- 
year continuation grant (FY 73 and FY 74)' was awarded to develop the project as a 
prototype for continuing staff .deyelopment, the Mark Twain Teacher Internship 
Program. 

Now beginning its seAad year of operation, the Mark Twain Teacher Internship Pro- 
^'graift helps fill the gRwing need at Mark Twain School and Mar k\ Twain School^Based 
Programs, as well as at other Montgomery County schools, for trained personnel to 
work with adolescents who have special needs. 

i 

FACILITIES 

. *> • 

Mark Twain Programs provide the setting for the Mark Twain Teacher Internship ;*ro- 
gram. The major portion of the training, including the seminars, takes^ place at 
Mark Twain School. Montgomery County public schools which ar3 sites for the Mark 
Twain School- Based Programs are used, along with Mark Twi^in School, for practicum 
experience. County and area special education facilitit.i«s ^ both public and pri- 
vate, are additional ttainlng resources. 



Hark TWaln School ' ^ * 

Mark Tvaln School is one of five special schools in the Montgomery County Public 
Schools system. Located on 22 .acres in Rockville, Maryland, and constructed at a 
cost of $3.2 million, the school opened for students in February, 1972. To 
establish an educational environment with balanced groups of students in small 
units, based on age, ph^/sical maturation, and social development, Mark Twain .has 
been arranged as three schools within one. The' lower school is composed of ''2 
instructional teatos, each with 50 students 10-12 years old. Grades 5-7, staffed 
by 6 tochers and T team leader. The miSdle school comprises lOO'^tudents , aged 
12-14, Grades 7-9, with 12 teachers atid 2 team leaders. The uppexf school consists 
of 50 students, aged 14-19, with 6 teachets ^d 1 team leader. 

/ , . • , ^ 

The major objective of Mark Twain School is to provide a short-term individualized 
educational program for preadolc scents and adolescents of at least average intel- 
luctual potential who are having difficulties in human relationships, self- - 
organization, or learning problems so that they c^n return and function well in a 
regular school. Scholastic skills are developed through a ta§k-oriented curric- 
ulum, highly individualized to meet the sjpecific needs of efch student. Students* 
strengths and weaknesses are identifil^d^^ -perceptual, .cognitive, and affective 
assessment and the results used to design appropriate instjructional materials and 
techniques. The Intent of the ins true tj^nal ^program is to remediate deficiencies 
while maintaining academic progr^Bss. At the same time, emphasis is placed on the 
development' of appropriate behaviors for p(Js^itlve Interaction .with peers and 
adults. Each student is assigned to a -^^eacher /advisor who counsels him jand serves 
as his , liaison with other "^taf f members^^ ' ^ ' 

lliree seminar rooms ^ere desig^ned for training 't>urposes when the school was built. 
Also potentially available; for training are 26 classrooms^ '3* science labs, 7 art 
labs, 37 offices, 6 conference rooms, and' 1 observation room, fhe Instructional 
.JResQurces Center, available to trainees, contains a print collection of 3,5IK) 
^itcs&s, 4,000 nonprint items (tapes, filmstrips, etc.) and professional periodicals 
Trainees have the opportunity to consult with support staff including a psychol- 
ogist, psychiatrist, social workers, nurse, medical advisor, axld< researchers, in 
additloa to teaching and staff development personnel. 

Mark Tw«:|ln School- Based Programs 

Mark Twain School-Based Programs were opcnratihgf^during the 1972-73 school year in 
12 Montgomery County public schools — 3 senior high schools, 8 junior high schools, 
and 1 middle school. ^ These programs serve a^ practicum sites for the trainees. 

School-based teachers provide support to regular classroom teachers by diagnosing 
student difficulties, both ac^emic and social, and providing for remediation 
plans. They suggest appropriate activities, materials, and techniques to use with 
these students. They defl^elop classroom alternatives with and for teachera and m^y 
serve as tutors. Trainees have the opportunity to work with the resourckj:eachers 
and with the regular classroom teachers and to utilize the resources of the^sc'hool 
^where the program. Is based. 
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Area Special Education Facilities 

A large number of public aftd privc e facilities providing specialized educational, 
therapeutic, and residential services are located, in the area; Various organiza- 
tions providing services to Jrouth ares invited ito send representatives £o/«ark 
Twain School to present to the trainees information about community organizations , 
facilities, and ipdividual^ dedicated- to providing and Improving services to 
county youth, T^nees visit sites ^nd participate in group discussions to share 
their experiences and increase their understandidg of resources in th^ area. 
Organizations visited during, the 1972-73 internship ar^ listed in Appendix B. 

Other Resou«:es " 

The Montgomery tounty Public'^ Schools Curriculum Library, containing approximately 
f20,000 volumes, and the Instructional Materials Center of Montgomery County Public 
Schools, are available to trainees, 

PROGRAM EVALUATION ' 

The purposes of the evaluation of the Mark Twain Teacher. Internship Program are to 
provide api)ropr'iate and timely' information: 

1. During the planning prototype dttjelopment year so that revisions in the 

, program can be based on this ei^ence and implemented as feasi-ble (forma- 
tive evaluation) 

2, At the end of each year and/or major' sequence so that ju'dgments can bfe 
made based on that information with regard to trainee t:ompetencies,j 
effectiveness of training activities i and progi^ss toward ^he development 
of the prototype program (summative evaluation) 

According to its continuation proposal to the Bureau of Education for the Handi- 
capped (May, 1972)., the Mark Twain Teacher Internship Program is "intended to test 
the feasibility of establishing a teacher development center within operational 
public school programs ior adolescents with special needs, .and presents an alter- 
native Jiechanism for attracting and preparing manpower for education of youth 
facing serious problems in living." As such, the ptogram anticipates several 
additional results: . ' 

^ a 

1. Montgomery County will be served with the preparation of personnel to 
Implement its continuum of educational servifces to learning and emotion- 
ally handicapped children. 

2. The program will serve as a prototype for others with similar needs. 

3. The prototype will be an innovative competency-based model for preparing 
teachers to work effectively with children and staff. 

The purposes, goals, and subgoals of the project as presented in the objectives 
section of the proposal were reviewed to» develop clear statements of thjB scope of 
the evaluation. This resulted in a restatement of the program goals an^ objec- 
tives and in a set of evaluation objectives to form the basis for communication ^ 
and action.' Table 1 shows the program and evaluation goals and objectives. 



TABLE 1 

Program and Evaluation Goals and Objectives 



Program 



Evaliiatlon 



Goal : To establish the school as a 
specialized straff development center for 
the prepar-atlon and continuing develop- 
'nent of personnel to work In educational 
programs serving preadolescents and 
adolescents 



Goal ; To establish evaluation pro- 
cedures to provide appropriate and 
timely information during the form-* 
ative stages of the project for pro- 
gram feedback and modification as 
well as to determine overall project 
effectiveness 



(fejective 1 . To identify and establish 
a- teachers-education facuJtty for J^he Mark 
TWain teacher-ilavelopment center 

Objective, 2 > To develop processes ^and 
procedures f or^recruitment and selec- 
tion of teacher interns 

Objective 3, » To- develop a competeijicy- 

based teadier-education curriculum j 

1 

Objective 4 * To iiiiplement the leajrning 
experiences and activities that vi/11 
ensure participant attainment of com- ^ 
petency in each of the following areas: 

a) Psychoeducational assessment' and 
programming * / 

b) Human relations and counseling 

c) .Curriculum development and 

implementation 

d) Behavior management 

e) Systems analysis and consultation 

Objective 5 * To develop! a functional 
system and methodology for evaluating 
knowledge » attitudes » and skills in 
five Specific teacher coii^>etency areas 

Objective 6 . To increase the nuiQber of 
trained personnel serving emotionally 
handicapped children 
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Objective 1 . To assess frfculty qual*- 
ifications* to determine if they are 
sufficient for performing required 
functions 'and -'duties 

V Objective 2 > To assess the effec- 
tiveness and feasibility of the 
recruitment and selection processes 

Objective 3 , To assess the ade- 
quacy of the multicompetency-based ^ 
teacher-development curriculum for 
its comprehensiveness and internal 
consistency 

Cfejectlve 4 , To assess each partici- 
pant completing the training program 
for his competency in each of the 
following areas: 

a) Psychoeducational assessment and 
programming 

b) Human relations and counseling 

c) Curriculum development and 
implementation 

d) Behavior management 

e) Systems analysis Md consultation 

Objective 5 , To assess competency 
assessment techniques for validity, . 
reliability » examine appropriatepess, 
and admlnlstratllve feasibility 

Objective 6 . To determine if person- 
nel completing the training program 
are effectively serving emotionally ; 
handicapped children and are utiliz- 
ing learned competencies 



Evidence acceptable to the program staff as well as the activities and tasks 
required to obtain it have been identified for each evaluation objective. The 
statement that this program is following a coapetency-baeed model, however, has 
grown in significance since the original proposal. As a result, th€ current 
evaluation report addresses some criteria (such as three suggested by Rosner, 
1972) which were i^t clearly developed pfior i'o the' Implementation of the 1972-73 
program activities* 

Tl)e evaluation personnel are members of the? Mark Twain School staff. Because of 
this circumstance, an independent educational .accomplishments audit (an external 
valuation designed to assess the appropriateness of evaluation procedures, both 
disign and implementation) was contracted with Dr. Malcolm Pirovus, director of th^ 
'^''ivaluation Riasearch Cfenter, University of Virginiar* A Eep^rate audit report will 
be submitted to the funding agency and to the local ^school system..^ 

IT. PROGR/ DESCRIPTION j ' 

, \ • . 

The previous section introduced the Mark Twain Teacher Internship Program, fbs 
goals and objectives and the context within which it was created and operates. 
This section presents a deicrlption of program operations in relation to the pro- 
gram objectives ad shown in Table 1, page 5,i • ^ 



Progress has been made toward attainment of all objectives. Th^ 1971-72 six-month 
Mark Twain Staff Development institute •trained 37 graduates who served as the 
original staff of Mark TWain School. Following the Institute, the Mark Twain 
Teacher Internship Program was established to prepare additional personnel for 
^ teaching adolescents with special needs. The 1972-73 an^ 1973-7A Mark Twain 
Teacher Internship Programs are ten-month training efforts. These programs ^se a 
performance-based curriculum, still in development, to help interns acliieve com- 
petency in the fiv^^^sic areas of psychoeducational assessment, human^^relations 
and 'counseling, curriculum development and Implementation, behavior manageihent, 
a^d systems analysis and* consultation. 

ESTABLISHMENT OF A TEACHER-EDUCATION FACULTY 

The emphasis in the Mark Twain Teacher Internship Program is on a competency-based 
model with integration of academic instruction and practicum experiences^ TTTe --j 
strategy §or^ prograni staff ing also revolves around the concept of competency areas 
Thus, each of five b^sic competency areas is coordinated by a member or members ofs 
the Mark rwain Program^ staff. Each competency area coordinator has responsibility ^ 
and authority for developing ann arranging the implementation of learning exper- 
iences In his basic competency area, in consultation withvhis planning staff and 
the training director. The role of competency area coordinator is intended^ to 
assure staff , responsiveness to the needs and reactions of trainees and to provide 
for consistency and direction In meeting program objectives. While visiting^ 
instructors, consultants, and guest lecturers make an important contribution to 
the oyerall program, the nature and. thrust of the educational program is determined 
by the Mark Twain Programs staff* The Mark Twain Programs staff assumes the major 
share of actual instruction and all of the practicum supervision of interns. ' 
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Lfevel 6. Pro gram Direction ;- Planning, 
developing, and managing processes and 
resources for impleai^ntatlon pf total 
program. ^ 

Level 5. Competency Area Coordination ; Planning, 
developing st^f and media resources for Implementa- 
tion, and evaluating competency-based curriculum. 
Instructing as arranged. / 

Level 4. Competency Area Planing ; Assisting competency area 
coordinator (s) in planning developing staff and media resourci 
for. implementatr.on'aod evaluating of tompetency-based curriculum. 
Instructing as arranged. - . *. 

lievel 3. Academic Instruction ; • Instructing one or iDore seminar sessloi 
coordination vrith competency area coordinator , outside of regular assigi 

Level 2.'' Practlcum Super vlfllon: Directing, guiding, supervising,* and evaluJ 
teaching activities within Che regular assignment. 

/Level 1. G eneral Support ; Cooperation, facilitation, and sharing of ideas and ri 
/ and faculty within the regular assignment. ^ 



t 



Fig. 1, Levels of Staff ResFonsiblllty in Mark Twain Teacher Education 




Level 6. Program Direction ; Planning, 
developing^ and managing processes and 
resources for implementation of total 
program. 

Level 5. Competency Area Coordination ; Planning, 
developing staff and ^edla resources for Implementa- 
tion, and evaluat;lng competency-based curriculum. , 
Instructing -as- arranged. 



Level 4. Competency Area Planning ; Assisting competency area . 
coordlaator(s) In planning and developing staff. and medi^ resources 
for Implementation and evaluat lija of competency-base*^rrlculum. 
Instructing as arranged. ^.J:^ ' 

tl 3 Academic I nstruction ; Instructing one or more seminar sessions, in 
■dlnatlon with competency area coordinator, outside of regular assignment. 

Practlcum' Supervision ; • Directing, guiding, suiiervising, and evaluating practlcum 
activities within the regular assignment. 

ral Support : Cooperation, facilitation, and ^hdrd,ng of ideas and resources with interns 

:thin the regular assignment. * , 
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Fifture 1 presents the contW^m "^^^l "^ef ^"^"8 ^^^^^^ ^"^^^.^ , 

r'esponsibility, in the Mark twain Teacher Internship Program. There are curreutly 
'kbout 80 prof ession^al ^aff within the Mark Twain ProgramsC of whom 47 hav(^ par- 
tifcipated actpely in the operation of the internship progi^am. 

Level 1 responsibility (general support) is the minimal expectation fol- all school 
faculty. Level 2 responsibility (practicum supervision) is arrived at through the 
mutual desire of Mark Twain Programs sfaff and internship adminisCraticn and is 
exercised withlln the regular professional work day. Thirteen members of Mark Twain 
School staff and 18 SchoolfBasoJ personnel have served as practicum supervisors. 
Levels 3 A, and 5 responsibilities (Academic InstfBction, Tompei-ency Ayfea Plan- 
ning, and Competency Area Qoordination) are optional (for staff) and require an 
* informal contractual agreement between the internship administration and the 
interested staff member. Levels 3, 4, and 5 faculty positions are paid appoint- 
mencs ^der a second job title of. "In-Service Consultant." Appointments Sre made 
on the basis of availability, commitment to training, and expertise in the rele- 
vant competency area, oiiring the 1972-78 Internship Program, 14 of the, Mark TVain 
School staff and 15 of TJi'e School-Based fv^ams staff were app^^nted as in- , 
service consultants. - / ■ ^ * 

In addition to the faculty of Mark Twain Programs, training su^i^orywas provided 
by Montgomery County Public 'Schools resource staff and outside cbtiSultants. 
Twenty-one experts were called iir' for presentations in their special fields. 

The 1972-73 faculty for the Mark Twain Teachfer Internship Program is shown in 
Appendix 'C. 

RECRUITMElijT AND SELECTION OF INTERNS 

The Mark Twain Teacher Internship Program of 1972-73 had a total of eight partici- 
pants, who were selected in August of ;L972 from among 21 applicants. The group 
included six women and two men whose prior classroom experience ranged from less 
than one year to nine years. One intern held a master's degree, and tour were 
working toward. graduate degrees at universities in /fie area. 

Six of the .eight interns were teaching in Montgoaery County Public Schools prior 
to entry into the program. The school system allows teachers who have worked in 
the schools for seven or more years to take one year of academic leave with 50 to 
60 per cent of their annual salary, depending upon the length of time they commit 
themselves to remaining in MCPS. However,, since the program hoped to attract 
teachers with a broad range of experience, an arrangement was inade whereby tenured 
school system teachers with only two to siic years of experience would be granted 
-"Unusual and Imperative" (U and I) leave to participate in the program and still • 
receive 50 to 60 per cent of their salaries. The two participants who had, not 
previously taught in Montgomery County received no .salary. Selected characteris- 
tics of interns are listed in TabJe 2. 

The same detailed and rigorous selection procedures used for the original Staff 
Development Institute of 1971-72 were used for the 1972-73 Internship Program. 
The procedures were designed to provide relevant data from multiple sources 
regarding the qualifications of applicants. 



*^ TABLE 2 



' Selected CharACterlsticc of Mark IVain Teacher Interns 





Internship Year 


Characteristic ' 


1972-73 


» 1973-7A 


Age - . 

Over 40 
31 - 40 
30 and Under 


1 

1 ^ . 
6 


0 
4 

» 4 w 


'^^^^ r- — 

Matt ' 

Female ---^ * 


2 
6 


IT 

3 ■ 
.5 


\: ^ ^ 

Education 

Bachelor *s Degree 

Ma8tejf*8 Degree 

Master's Degree in progress* 


• 3 
1 
4 


{ ' 1 


Classroom Teaching Experiente 

7 years or more» 
2-6 years , j 
Less than 2 yeats ' 
None ' ^ 


* * 

5 

\ 0 

1 


0 ^ - 

0 


Years in MCPS 

7 y^ars or more 

2-6 years 

Less than 2 years / 

None, 


< 

0 
6 

0 

2 - 


✓ 

2 
4 

0 ' 
\ ^ 


Previous Assignment 

Secondary School Teacher 
Elenhentary School Teacher 
Nonteachlng 


2 
5 
1 


3 
4 
1 



♦Indicates graduate study in a degree program. Does not Incl'jde nondegree or 
«• In-servlce course work. 
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Recruitment procedures consisted of (a) announcement of teacher internships ixi 
the Superintendent's Bulletin , (b) orientation sessions for interested persons, 
and (c) dissemination of basic information and reference material about the pro- 
grams Because of delayed notification of funding continuation from the Bureau of 
Education for the Handicapped, applicants could not begin to be accepted intil 
June, 1972. TWo orientation sessions were held to give Interested teachers basic 
Information and reference materials on the program and the planned selection 
process. 

The selection process consisted of two phases. Phase I was a revii^ by a Selec- 
tion Committee of four sources of data on applicants: ^ 

1. A summary of the applicant's MCPS pers6nnel fodder 

2. Mark Twain Supplementary Application Form 

'3. Personal references obtained by telephone or mail 
4. Groufp interview 

The Selection Committee was made up of eignt persons, incluJiing the Internship 
Program directory two representatives from the Mark Twain Competency Coordination 
Group (Level 5 staff), the Mark Twain School principal, the supervisor of School-, 
Based Prograij^s, two representatives from the MCPS Department of Staff Development, 
and one representative from the MCPS Department of Professional Personnel. 

Those applicants who passed Phase I returned for Phase II which consisted of 
Intensive individual interviews. Observation of applicants' classroom perform- 
ance, which was part of the selection process for many participants in the 1971-72 
Staff Development Institute, .was not included since applications could not be 
Invited until the close of the school year. A maximum of 16- internships had been 
authorized for 1972-73, twelve for regular MCPS teachers with two or more years of 
successful ^experience aXid four for teachers not currently employed by MCPS but 
with high potential for successful future ^seifvice. * 

Recruitment and selection of interns for the 1973-74 program began in February, 
1972, an<J followed the same rigprous procedures with the additional requirement of 
a minimum of 2 years of successful classroom experience. Some characteristics of 
the eight selected from ampng 27 applicants also are found in TahJe 2. 

^c^fiRRicuLUM Development \ ^ 

* 't 

The curriculum foi: the Mark Twain Teacher Internship Program (1972-73) was based 
on a ten-month, full-time learning experience. 'This curriculum was comprised of 
anr integrated schedule of seminars, practica, and Individual projects organized 
around the development of trainee competence in five b^sic areas. Competency area 

'coordinators were responsible for redefining subcompe^encies and identifying per- 
formance and behavioral objectives relevant to each subcompetency . The presently; 
defined 15 subcompetencies and their related '.performance and behavioral objective^ 
are found in Appendix D, « The five basic competency areas, exaqmples of subcompe- 

'tencies, performance objectives, and topics covei^d follow: \ 
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Psychoeducatlonal Assessment and Programming 

Two subcompetencles relate to (a) the ability to complete psychoeduca- 
tlonal profiles and (b) use of these profiles In planning programs for 
Individual students. Performance objectives for the 'first subcompetency, 
for example » Involve the ability to administer and Interpret assessment 
ln8tn:|ments In the affective, perceptual, cognitive, and educational 
domains and to Integrate^data from these Instruments Into a valid psycho- 
edjucational profile. Curriculum units covered thfi following topics: 
extracting and categorizing data frtom pupil cumulative records; nature 
of Intelligence; measuring intelllgefice, achievement, and* aptitude; cog- 
nitive development and classification of skills in the cognitive domain; 
perceptual development and assessment; assessment of specific learning 
disabilities; techniques for teaching children with specific learning 
disabilities; assessment of learning styles and human relationships; and 
planning student program adjustments. 



The three subcompetencles in this area include (a) the ability to com- 
prehend and communicate effectively in an educational fset ting, (b) the 
ability to interact with empathy, respect, specif icityV self-awareness, 
and self-acceptance in an educational setting; and (c) the ability to ' 
facilitate attainment of humanistic educat;ional objectives in groups. 
An example of a performance objective for this competency- area is the 
demonstration of ability to comprehend communications, in terms of con- 
tent and feelings, with students and peers, in a counseling interaction. 
Curriculum units covered the following topics: counseling as helping 
human relations; nature of helping relations: process and dimensions; 
syst^oatic human relations training: empathy, respect tod specificity; 
improving human relations; discriminating content from feeling; issues In 
application of counseling skills to the classroom setting; counseling the 
reluctant student; strategies for developing 3 curriculum for counseling; 
classroom group discussion techniques; and self-acceptance and self- 
awareness as basic counseling functions. 

Curriculum Development and Implementation 

Four subcompetencies are specified in this area. These are (a) the 
ability to plan and organize an instructional system, (b) the development 
and selection of appropriate curricula for special students, (c) the 
planning and Implementation of appropriate learning activities and teach- 
ing strategies, and (d) the selection and development of appropriate 
resource materials. One performance objective specified is the demonstra- 
tion of ability to integrate strategies from various sources into a 
Curriculum appropriate to students. Curriculum units covered the follow- 
ing topics: organizing the learning environment; student planning and 
feedback techniques; formulating behavioral and performance objectives to 
meet cognitive and affective needs; /curriculum planning strategies; strat- 
egies for teaching: role. playing, sypectlcs, ' inquiry, and value clarifi- 
cation; curriculum approaches to humanistic and aesthetic education; games 
and simulation techniques; and selection and development of instructional 
materials; procedures, criteria, matching to. learning problems and special 
characteristics, values of multimedia, and types of equipment and material 
available. 
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4. Behavior Management 

The following three subcompetencies are defined: (a), the ability to 
establish and reinforce behavioral values, expectations, and limits in 
an educational setting; (b) the ability to identify and teach strategies • 
for coping vdth conflict and frustration in an educational setting; and 
(c) the ability to develop and use teacher-intervention techniques to 
effectively manage disruptive school behavior. A related performance 
objective is the application of operant ^ surfacermanagenent , arid life- 
space interviewing principles in problem situations. Curriculum units' 
covered include the following: criteria for Identif ipation of emotional 
disturbance; alternative ^approaches to educating children with special 
needs; clarifying behavior values^ and limits; strategies for reinforcing 
behavior values; types and sources of conflict, in adolescence; coping 
with frustration; intervention techniques for disruptive behavior; and 
surface management, life-space interviewing, and oper^t procedures. 

5. Systems Analysis and Consultation / 

Three subcompetencies relate to (a) the ability to formulate and commu- 
nicate concepts of family and community systems, (b) the use of organiza- 
tional processes for resolution of student conflicts, and (c) consulta- 
tion With others for understanding student and staff behavior within a 
system. " An example of a performance objective is the demonstration of 
ability to assess how family, community, and educational factors affect 
student functioning In a particular school setting. Curriculum units 
include the following topics: understanding the system; function of 
^ roles, values, and norms; concept and importance of communicated expecta- 
tions; models for effecting system change; crisis resource .teacher ; 
diagnostic-prescriptive teacher; problem solving through systems analysis; 
'the family as a system; understanding relationships in a family system; 
^ a Mdel for teacher consultation; critical incidents for consultation; 
Styles and objectives of teacher consultation;* and posit'ive itjtervention 
in negative feedback cycles. ^ 

The content of all courses is being organized into curriculum packets containing 
relevant objectives, sequenced instructional units, learning activities, resource 
materials, and evaluation activities and criteria. In addition, a core set of 
objectives will be specified as required for all trainees; others will be desig- 
nated as elective depending* on the trainee's individual strengths, weaknesses, 
and plans for future teaching. 

LfeAllNING EXPERIENCES AND ACTIVITIES 

The 1972-73 Mark Twain Internship Program provided a 41-week training schedule of 
104 two- and-one-half -hour seminar sessions and 33 weeks of practice teaching in 
both Mark Twain School and School-Bas<d Programs. The 10-month learning experi- 
ence began in late August, 1972, and ended in late June, 1973. A variety of 
activities were included, which may' be grouped as (1) seminars, (2) practice, and 
(3) individual projects. 
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1. Seminars Cf 

Seninars are the basic elements for competency-based instruction In the Mark 
Twain leather Internship Program^, Seminars were conducted In each competency 
area under the direction of the competency area coordinator and involved a 
specified number^ of group sessions. Each seminar session usually was struc- 
tured to Include explicit subject content as well as spontaneous discussion. 

2. Practice ' 

Practicum experiences are supervised applied learning jsituat ions in which the 
Intern partiiapates. directly in actiyities that bxa^^bI samples of profes** 
slonal role function and responsibility. Tijo major practice were offered: 

a. Practice Teaching 

Interns were required to complete at least 600 hours of supervised teach- 
ing in Mark Twain School and Mark Twain School- Based Progt;ams. Interns 
were placed in both the Mask Twain School and a School-Bas^ Program 
during the first and second of three .practice teaching cycles. The third 
cycle was a mora extended » almost full--tlme practice teaching\experience 
arranged on the basis of individual interest and specific training needs « 

During practice teaching cycles » the intern was assigned to a prrticular 
teaching team» with one member of that team identified as ithe primary 
^^^^.atfpervisor. The intern and his supervisor so^ught to develops shared prac- 
ticun objectives and met regularly to discuss progress and issues related 
to those, objectives. ^Progress has been made on identifyitig practicum 
goals and expectations within each practicum placement site and x^lating 
them to competency area objectives. 

9> - - 

b. Practicum" in Techniques to Facilitate Human Relations 

All interns participated in a small self-study group with a trained group 
leader. The purpose of this laboratory group is to promote increased ^ 
self-acceptance and awareness through direct experience of faoilitatiftg 
activities. In this applied context* Interns had ample opportunity to 
^q)lore many areas of human relations such as sharing concerns and reac- 
tions » seeking and providing feedback, listening and consulting, transi-. 
tidn and separation, and confronting limits and expectations. - 

3. Individual Projects 

Interns were expected to pursue at lea^t two areas or units of study that were 
particularly suited' to personal needs apd interests.. Elective projects were' 
offered in each competency area as well as in a cross-competency area relating 
to issues in special education and analysis of teaching. Host projects were 
developed for application to actual teaching roles. Individual projiects were 
arranged with appropriate competency supervisprs and completed during the 
final practice teaching cycle of the internship. Each project involved 
approximately 30 hours of work. Including superv4.sion, and resulted in the award 
of one in-service credit upon satisfactory completion. 
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Ihe lO-month ihternship was divided into four learning sequences— an Initial 
5-week sequence and three ll-week sequences (fall, winter, and spring). The 
sequences were designed to keep pace with interns* developn^ntal needs (ejg^. , 
begitoJLng with general problems of adolescents and ending with considerations ^ • 
in consulting with other teachers) . 

The fall, winter, and spring sequences were followed by one-week periods of 
review and evaluation. During these periods, interns were expected to demon- 
strate competencies gained during the sequence, complete instructional as||lgn- 
oents, and participate ir program and self -eval*t ion. The schedule can be seen 
in Figure 2. 

DJEVELOPMBNT OF INTERN EVALUATION METHODOLOGY 

A variety of procedures, both formal and informal, were used to assess intern 
attainment of comKetency. Validating tasks were presented as part of semiaar 
Instruction, as^utside assignments, and during review and evaluation periods. 
In keeping with the model o*" performance-based instruction, interns were given* 
multiple opportunities to Improve performance until reaching acceptable levels. 
In March, May, and June, 1973, interns received status reports of progress towarii 
meeting program objectives. The results of performance measures along with 
informal observations were used ty instructors for ratings^ on seminar perfortaance 
in the subcompetencies . In addition, interns were rated by each of their three 
practicum supervising teachers to indicate the. extent to which the subcompetency 
was in evidence at the practicum site. Practicum ratings were weighted and 
averaged the seminar rating, producing a final grade point average, for each 

subcompetency. Final grade point averages were then categorized and subcompe- 
tency performance recorded as Highly Effective , Effective, or Needs Strengthening . 
Finally, Level 5 Program staff assigned a consensus rating of the extent to which 
the intern demonstrated the highly valued and encouraged personal characteristics 
of (1) emotional stability, (2) positive interpersonal relations, and 0) initia- 
tive. The Intern Evaluation Form is found in Appendix E. > 

Development of a functional system of evaluating the effectiveness of the program 
includes, in addition to measuring attainment of competencies by interns, deter- 
mination of (1) a procedure for integrating evaluation data into program modifica- 
tion^ (2) the validity and reliability of measurement Instruments used, and (3) how 
program events contribute to competency attainment. 

Events were monitored during the year, resulting in continual modification of 
schedules, instructional format, and requirements. Weekly feedback from and to 
interns on program Implementation and progress was accomplished through written 
and verbal means from the f^rst week of the internship. 

The review and evaluation (R and E) periods following each program phase were used 
to identify discrepancies between stated^ or desired objectives and actual proc- 
esses and to recommend action to reduce these discrepancies. For example, follow- 
ing the December, 1972, "R and E" week, greater priority was assigned to identifi- 
cation and accomplishment of practicum objectives and less to completion of new 
seminar assignments; as a result of the March, 1973, ''R and E" week, schedules for 
final incern assessment in June were revised to reduce anxiety and excessive task 
load. 



Pltim Inf 
and 

BMtllnt 

EvtluAtioa 

(1972-73) 



Fl r»t St^ucnce 
(S weekji) 

OrlentAtion to Mark IWaln 
School and School-Based 
Prografltt 

Seminars : 

1. MoljMcent Problems 

2. Baha'ftor 



Management 



Practlca: 

1. Adolescent Life 
Space E3(perlence 

2. ^ Human Ralations 



July 



August September 



Fall Sequence ^ 
(11 weeks) 

Privet ice Teaching #1 



Seminars : 

1 . Psychoeducat tonal 
Assessment 

2. Behavior 
Manafeaent 

3,. Curriculum 
Development 

4. Anal, of Teaching 

5. Issues In Special 
Educat Ion 



Practlca: 

1. PsychoeducaClonal 
Assessment 

2. Human Relations 

3. Team Collaboration 



October November December 



Winter Seguance 
(11 weeks) 

Practice Teaching 
#2 



Seminars: 

1. Counseling . , 

2 . Classi;ooo 
Organization 
and Individual 
Instruction 

3. Currloulua 
Development 

4. Analysis of 
Teaching 

3.^ Issues In 
Special 
Education 



Practlca: 

1. Human Kfrlatlona 

2. Team "Collabora- 
tion 

3. Counseling 



Spring Sequence 
(11 weeks) 

Practice Teaching 
#'3 



Seminars: 

1. Counseling 

2. Classroom 
Organization 
and 

Individual 
Instruc|ion 

3. Curriculum 
Development 

4. Supei^islon 
and 

Consultation 
Issues in 
Special 
Education 



5. 



Practice: 

1. Human 
Relations 

2. Team O^llabo- 
ration 

3. Counseling 

V 
A 
C 
A 

T , 
I 
0 
N 



January I February 'March ^ April May June 



Program 
Planning 

and 

Baseline 

Evaluation 
(1973-74) 



First Sequence 
(3 weeks) 

Cteientation to Mark TVain 
School and School-Based 
Programs 

<;«»minar8 

Review and Evaluation 



" Second Sequence 
(7 weeks) 

Practice Teaching #1 

(2 full days plus 3 half 

days, 26 hours per week) 

Seminars (3 per weel) 



Ttil rd Sequence 
(3 weeks) 

Review and EvaluaCicn 



Seminars (4 per week) 



September 



October 



Fifth Sequenc_e 
(2 weeks) 

Raview and Evaluation 



Seminars (4 per week) 



January 



Sixth Sequence 
(16 weeks) 

Practice Teaching #3 (5 days, 35 hours) 
Individual Projects 
Seminars (1 per week) 

V 
A 

I 

T 
I 
0 
M 



February 



March 



April 



November 



Fourth Sequence 
(7 weeks) 

Practice Teaching #2 
(2 full days plus 3 half 
daya, 26 hours per week) 

Seminars (3 per week) 

V 
A 
C 
A 
T 
I 
0 
N 



December I January 



May 



Seventh Sequence 
(3 weeks) 



Seminars 

Cot4>letlon of Requirements 
Review and Evaluation 



June 



Fig. 2. Mark TValn Teacher Int^hip Progrmm^ Schedule . 1972-74 
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Muwh progress Was made on •^the development of teacher*-made tests of competence. 
Soma specific task was required, as a demonstration of either skill or knowledge, 
for aosc of thCf stated performance objectives. These will be fui;ther refined 
durlof* the 1973-74 Internship Program. Work has begun on Instruments to measure 
teaching behavior under actual or simulated classroom conditions at the subcom- 
petency level. These will be used as independent validation of the related 
Instructor-made performance objective criteria and, possibly, as criteria for h 
certification. ' q 

During the 1972-73 Internship Program, instruments were developed to test the 
validity of the program and its relevance to the performance of various^roles in 
the teaching of adolescents with special needs,. These include (1) a critique of 
the instructional program by the interns (Appendix F) and (2) a critique of th^ 
Mark TValn Staff Development Institute by graduates who have now performed suf^- 
cessfully for '^lore than a. year as teachers in Mark TWain School (Appendix G). In 
addition, pre- and postinternship surveys now provide indications of grodp shifts 
tn values and attitudes toward adolescents, student behaviors, teaching, and self 
after exposure to the program. 

STAFF DEVELOPMENT 

Inherent in the ccacept of the Mark Twain Programs is the ^conviction that student 
growth and progress hinges upon the skill, sensitivity, and flexibility of the 
faculty. Service to pupils is thus seen as intertwined with staff development. 
The ultimate goal o.f the Mark Twain Teacher Internship Program is to develop open, 
mutually supportive, resilient, effectively coping educators Who can, through 
words and actions, truly sustain a "humanizing educational environment" both for 
themselves and their students. I 

The Staff Development Program began with the iii^lementation of a six-month insti- 
tute for the staff of the Mark Twain School (from July 1, 1971- January 14, 1972). 
This institute provided a solid base from which Mark Twain is expanding .its con- 
tinuing education mission for educational personnel throughout the school system 
as well as for its own staff. Of the 38 participants in' the 1971-72 institute, 
37 accepted employment and 32 are still employed in Mark Twain Programs. Seven 
of the eight 1972-73 interns have accepted employment either in Mark Twain School 
or in School-Based Programs. In addition, of the 80 professional staff within - 
Mark IVain School and School-based Programs, almost 50 participated in internship 
program instruction. I 

Montgomery County Public Schools, through the State of Maryland, has approved the 
program for the awarding of in-service credits toward professional development 
and additional certification in special education for originally certified 
teachers. In 19/2-73, 16 In-service credits of instruction' were offered to 
Interns through seminars. Ten in-service credits were awarded for completion of 
practice teaching (600 hours) in both Mark^ Twain School and School-Based Programs. 
One-credit Individual projects, laboratory groups, or survey units brought the 
core competency-based curriculum to 30 in-service credits, as shown in Table 3. 
Adjustments have been made in the 1973-74 schedule so tha*- each competency area 
can of f er a seminar course carrying three in-service credits (Table 3). These 
will be opened as Individual in-service courses during the fall semester to Mark 
Tveain Programs faculty and in the spring semester no interested MCPS teachers in 
addition to being the core courses of the 1973-74 Internship Program., 

•'•! 
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TABLE 3 

Suoiiiary of In-Service ^Courses andjCredits for 
Mark TWain Teacher Internship Program 







Credits 


Competency Area 


ins uruc u lonax uou^onen u 


1972-73 


1973-74 


Pgychoeducational Assessment 


Psychoeducational Assessm^t 


3* 


3* 


and Programing 


Seminar 








Psychoeducational Asses^nent 


1 


1 




Project . 






Human Relations and 


Individual and Group 


3* 


3* 


Counseling 


Counseling Seminar^ 








Counseling Project 


1 


1 




Techniques in Human Relations 

L 


1* 


1* 


Curriculum Development and 


) 

Curriculum Development and 


4* 


3* 


Implementation < 


Implementation Seminar 


1* 






Curriculum Project 


1 


Behavior Management 


Behavior Management Seminar 


3* 


3* 




Behavior Management Project 


1 ' 


I 




Adolescent Development 


1* 






Seminar 






Systems Analysis and 


Systems Anaiy^i^ and 


3* 


3* 


Consultation 


Consultation Seminar 








ayscens Analysis rrojecc , 


1 


1 






(600 hrs.)^ 


(900 hrs.) 


Cr OS 8-*Compe t ency 


Practice Teaching 


10* • 


14* 




Issues In Special Education 


1* - 3 


1 ' 




Analysis of Teaching 


1 


1 




Mnlcourse 








Adolescent Life Space 


1 


1 . 




Experience 















Notes : s 



1. tlequired credits indicated by asterisks* t 

2. Two elective credits required. 

3. Credits needed for graduation - 30 in 1972-73 and 32 in 1973-74. 

4. Maximum credits attainable • 34. 
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Hontgome'ry County Public Schools has, by directing Mark Twain to develop staff as 
well ad students, moved to provide a mechanism for self-renewal. 

» III! EVIDENCE OF ATTAINMENT OF OBJECTIVES 

^ • 

This section will review and evaluate the evidence of attainment of the six pro- 
gram objectives designed to meet the primary program goal, the establishment of . 
Mark Twain School' as a sp^c^ialized staff development center for the preparation 
ismd contijauing development of personnel to work in educational programs serving 
preAdolescents and adolescents. The six program -objectives are: 



Objective I 



9 



To identify and establish a teacher-edutation faculty for the Mark ^wain 
teacher-development^ center 

• Objective 2 - > * , 

To develop processes ^d procedures for recrui^raenj and selection of teacher 
Interns ^ 

Objective 3 * 'O , . 

To develop a competency-based 'teacher-'development curriculum * 
Objective A*^, , 

To implement the' learniag experiences and activities that will ensure partic- 
ipant attainment of coiii|petency in five specific areas 

Objective 5-^ , 

«. ^ 

To develop a functional system and methodology for evaluating knowledge, 
attitudes, and ^l^llls in five specific teacher competency areas 

Objective 6 

To Increase %h& number of trained personnel serving emotionally handicapped 
children 

These objectives were developed in planning the Internship Program based on the 
experience W the -Mark Twain Staff Development Institut*** and, with the development 
of corollary evaluation objectives, serve as the basis for evaluation of the Mark 
Twain Teacher Internship Program. . 

OBJECTIVE 1 ' ' . 

Program Objective 1 

To identify and establish a teacher-education faculty for the Mark Twain teacher- ^ 
development center 
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Evaluation Objective 1 



To assess faculty qualifications to uetermlne if they are sufficient for perform- 
ing ftinctions and duties 

f 

Evidence of Attainment of Objective 1 

A. Professional Preparation and Previous Experience of the Mark, IWain Teacher 
Internship Staff 

Responaibillty for the Mark Twain Teacher Internship Program is a continuum 
with major involvement and accountability for both planning and instruction at 
Levels 5 ai^l 6 (see Figure 1, page &)• The professional preparation and previ-' 
ou8 experience of scaff at these levels is giv^n in detail in Appendl?c H. Of 
the eight staff members at these levels, five have advanced degrees » two at the 
master *s and three at the doctoral level. All ar^ involved in supei^isory or 
instructional aspects of the Mark TWain School or the Mark Twain School-Based 
Programs. 

B. Weekly Intern Feedback 

Throughout the year, interns commented each week on the events of t^at week in 
seminars and practice. Intern Feedback Forms requested, in addition to the . 
listing of activities found especially use'ful or not useful » specific sugges- 
tions fox improvement of various aspects of J^he program. The completed forms 
were circulated to seminar and practicum coordinators, as appropriate, and 
used as formative evaluation of program and instruction. Feedback, ranged from 

*'...wa9 great, time flew, filled to the brim," "Tuesday's seminar was 

excellent," "Good!", " 's performance exceptional^" to " 's seminar 

was a bomb!" and, " 's seminar was overwhelming and difficult to under- 
stand." vn^enever possible, suggestions of participants were implemtotedf 

As a result of feedback from 1972-73 interns, a number of actions were taken. 
A special consultant -was not rehired for the 1973-74 internship. Fewer 
visiting speakers were scheduled. Feedback concerning practicum supervision 
and coordination resulted in the redefining of. t^e practicum coordinator^^ 
role as completely facilitative rather than as including an evalu^^ion func- 
tion. 

C. Ratings of Effectiveness by Participants ^ . , 

During ''tii^^ 1972-73 internship period, procedures were developed and^ imple- 
mented for program participants to assess internship facujLty performance. At 
the conclusion of their training, interns responded anonymously to a ques- 
tionnaire designed , to elicit their opinions about severe^ a&pects of the pro- 
gram. Questions 1-12, 18, and 21 -b refer specifically to instruction. Since 
the information was to be used for program revision' and improvement, answers 
were requested separately for each competeiicy area. The questionnaire and 
suamiarlzed ratings can be found in Appendix F. In general, interns expressed 
OK>derate to high satisfaction with faculty 'performance. Responses averaged at 
. a rating of 3.8.*on a 5*i4>oint scale, with greatest satisfaction expressed in 
response to questions on instructor availability » helpfulness, and preparation. 
The average rating of the teaching skill of instructors (Q. 18) was 3.36 on a 
scale of 5; the average rating on the effectiveness of instruction (Q. 21-b) 
was 3.45 on a scale of 5. 
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in ;ji«Ly, 1973, .Mark Twain School staff who^had been participant's in the 1971- 
72 Mark Tw&L^ Staff Cevelopment Institute were ^ked to respondVto a question- 
naire deil^d to elicit^ their opinibns of their training progr^in^ Institute 
graduates, after performing in the roles for which they were trainfeA^^^^jxpressed 
a moderately high level of sat fis faction, with responses averaging 3.4 on ' 
a 5-point scale. ^Generally, ratings for personal interactions with the instruc- 
tional staff averaged somewhat higher (near 4 on a 5-point scale), while 
ratings for instructor effectiveness at transmitting useful knowledge and 
skills were somewhat lower (about 3). The questionnaire and suBBiarized ratings 
can be seen in i^pendix G. ^ 

Discussion and Recommendations 

The Mark Twain Teacher internship Prorgram is jiow in its second year of operation 
following the six-month tiark Twain Staffs Development Institute* The suctess of V 
this program provides strong support for the assumption that an internship ^* 
-faculty, drawn from the Hark Twain Programs staff,, is qualified by training. and . 
experience to perform the ^.f unctions ^^^ff'^SuH^s necessary for program planning and. 
delivery. ^ ^ 

A rigorous formal evaluation of faculty qualifications was not accomplished during 
the prograK;! .year. The criterion problem, that is, the determination of qualifica- 
tions needed. to perform specified duties, proyed to be complex and requires con- 
•siderabifc developmental work. Therefore; the limited resovrces available were 
directed toward acquiring the information presented above. ^ - 

The result.ing evidence, obtained through weekly feedback and from surveys of 
current participants and one-year graduates, offers data relevant to the effec- 
tiveness of instruction. Formative assessment of faculty performance by means oi 
Mekly feedback was generally pdsitive. A number of adjustments of function, 
changes of personnel, and modification of schedules and activities were^made, at 
least partially, on the basis of weekly feedback. This means of obtaining and 
Utilizing weekly feedback should be continued. Results from the summative progr/***. 
participant questionnaire concerning effectiveness of instruction also were gener- 
ally favorable. Ratings were slightly higher for the Psychoeducational Assessment r 
and ^rograraaing. Human- Relations and Counseling, and Behavior Management Compe- 
tency Areas. These higher ratings may be attributable to the fact chat these 
competency areas are in a more advanced stage of development than are the areas 
of C)irriculum Development and Inqfilementation and Systems Analysis and Consultation.. 
One-year graduates of the program rated the effectiveness of instinct ion favorably 
but slightly lower than, did current interns. The faculty .for fhosCs two program . , 
years, however, were substantially different. j 

Recognizing tha fact that the solution of the problem of determining criteria for 
qualifications specific to role duties and functions would exceed the resources - ' 
available for the next program year (the final grant year), the following recom- ^ 
meudations are made: 

Duties and responsibilities of each faculty position, including p^acticum / 
supervisors, should be more clearly described. ^ 

* ' • 
' ,,\)uallfylng criteria for faculty positions should be described, i.e . , ' % 
education, relevant experiences, publications, demonstrated competence, etc. 
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Criteria should be established to enable experts to judge the "quality" of 
the faculty based on the above information plus participant ratings of 
instructor effectiveness. 

Since academic instruction and competency area planning and coordination 
prepaid appointments under a second job title of "In-Service Consultant," 
consideration should be given to making practicum supervision a paid appoint- 
' ment; it, too, is Integral to program operation and requires considerable 
commitment to the training mission. 

OBJECTIVE 2 

Program Objective 2 

To develop processes and procedures for recruitment and selection of teacher 
Interna . . ^ 

Evaluation Objective 2 

To assess the effectiveness and feasibility of the recruitment and selection 
processes 
1 ^ 

Evidence of Attainment of Objective 2 

A. Feasibility. and Effectiveness of Recruitme^^t 

Recruitment for the 1972-73 Internship did not begin until June, 1972, when 
the Continuation Grant was approved. Considerable public interest and' 
inquiry had been generated by the Staff Development Institute and the opening 
-of Mark Twain School to students. The major recruitn^nt effort was an adver- 
tisement placed in the Superintendent's Bulletin , a weekly publication cir- 
culated to all MCPS personnel. Twenty-one people completed application for 
participation in the program. In order to elicit a larger number of appli-- 
cants for the 1973-74 internship, recruitment efforts began in February, 19 73. 
In addition to periodic announcements of the program in the Sup er in t end en t * s 
Bulletin , presentations were made to nine selected MCPS groups. Three orien- 
'tation sessions were held at Mark Twain .School to publicize the program and 
to invite applicants. Twenty-seven applications resulted from the recruit- 
ment efforts for 1973-74. 
f 

Of the 21 applicants for the 1972-73 internship, 7 withdrew their applications, 
* 1 after Phase II selection for the program. Of the 27 applicants for the 

1973-74' internship, 11 withdrew their applications, 1 after Phase II selection. 
See Table 4 on page 22 for final disposition of applicants for Mark Twain 
„ Teacher Internships. y 

B, Feasibility and Effectiveness of Selection 

The selectioifi process for interns required completion and review of personnel 
data, applications, and references^ as well as group and individual interview^. 
As Indicated in Table 4, of the 21 ipplicaats for the 1972*^73 internship, 8 
were accepted, 5 were not recommended, and 1 was recommended for reapplication 
the following year. Of the 27 applicants for the 1973-74 internship, 8 were 
accepted, 7 were not recommended, and 1 was recommended for reapplication the 
following year* 
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Final 'Disposition of Applicants for 
Mark Twain Teacher Internships 





1972-73 


1973- 




MCPS 


Non-MCPS 


MCPS 


Non-MCPS 


Recdmniended and Accepted 


6 


\ ■ 




6 


2 


Not Keconsnendi^d 


.3 


2 




5 


2 


Withdrew After Selection* 


I 






1 




Withdrew Before Selection** 




2 




8 


2 


Reconmended for Reapplication 












Next Year*** 


1 






1 




total 


15 


— 9-^ 


21 


6 



*In both ca^es, personal reasons not related to finances or lack of M.A. degree. 
**Most frequent reasons given: Financial; no M.A. degree. 
♦♦♦Insufficient teaching experience. 

Discussion and Recommendations • 

The recruitment procedure for 1972-/3 proved less effective than desired, result- 
Ine in only 21 applicants, 7 of whom withdrew their applications. Earlier and 
more extensive recruitment efforts for 1973-74 resulted in only a few more appli- 
cants. Personal financial, considerations and the program s lack of a degree 
granting authority seem to be significant deterrents to applicants. 

In view of the difficulty of recruiting teachers with seven or more years experi- 
ence in Montgomery County Public Schools, permission has been requested for flex- 
ible administration of the 12 internships , allowing the use of as many U and I 
appointments as needed to fill the 12 MCPS places with qualified applicants. The 
four non-MCPS internships have be^h regained with the^addition of a prerequisite 
of at least one year of successful classroom experience. 

It has been recommended that an additional financial option of 70 per cent 9f 
current salary be mAde available to MCPS interns. This option would require a 
signed commitment , to continue in MCPS for at least three years. Such an o^ion - 
might attract more experienced teachers for whom the present options represent an 
unacceptable financial sacrifice, particularly for heads of families. In addi- 
tion, a three year ."pay-back" would fit well with the concept of career rotation 
along the educational" services continuum. 

The high rate of withdrawal of applicants seems to suggest some lack of clarity 
of information provided *in recruitment efforts, particularly since the reasons 
stated for withdrawal were financial and degree-related. 
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• The selection process » while lengthy and time-consuming » does indic|(|||[ sorae^--^^^ 
degree of commitment ^on the part of both applicants and staff. The necessity of 
using the' entire pfotedure for every candidate was illustrated by t:h«rHFirct that 
the intern who performed least effectively (ranking eighth) was accepted without 
complete selection data. The effectiveness of the selection process, resulting 
in only eight interns each year when 16 had been, authorized, is subject to inter- 
pretation. While all eight interns selected for the 1972-73 program completed the 

^program successfully, there is no evidence to indicate how applicants who were not 
selected might have fared in the program. In view of the fact that the preliminary 
evaluation plan called for 10 interns as evidence of successful recruitment and 
selection, it is teiq>ting to reduce selection standards.^ However, bepause of the 
demanding nature of the program, it has been decided to maintain high selection . 
standards, and to follcm complete sele^^on procedures with emphasis on an intensi- 
fied recruitment effort to increase ^e number of participants. 

In order to increase the effectiveness and feasibility of recruitment and selec- 
tion procedures,, the following recommendations are made: ^ 

Recruitment y^forts should be started in November and continued throughout 
the year. 
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Recruitment data from 1972-73 and 1973-74 should be analyzed to determine 
the feasibility of defining a target audience. 

Possibilities for obtaining state authorization for the awarding of a M.A. 
degree following successful completipn of the program should be explored. 



OBJECTIVE 3 

Program Objective 3 • . 

To develop a competency-based teacher-development curriculum 
Evaluation Objective 3 

To assess the adequacy of the multicompetexicy teacher-education curriculum for its 
co]q>rehensivenes8 and internal consistencv 

^/ • 

Evidence of Attainment of Objective 3 

A. Judgment by Program Staff < 

1« Coffl|)etency area coordinators continuously reviewed and revised the curri- 
cu^lum , through weekly group planning sessions. Learning outcomes based on 
priorities generally recommended in the literature for teachers of special 
children were specified for five learning areas in terms of 15 subcompe- 
tency statements. Each subcompetency is defined by statements of perform- 
ance objectives, and these statemeCits are further defined by statements of 
behavioral objectives (See Appendix D). Documentation of the curriculum 
*has be^ obtained through sesslon-by-session descriptions which iiiclude 
topic, instructor (s)\. learning activities, resource materials, evaluation 
criteria, related performance objectives, and behavioral objectives. 

r 
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2. Practlcum supervisors in both Mark Twain School and School-Based settings 
participated in development of the curriculum by rating the' importance of 
the stated subcompetencies as they perceived them in relation to working 
effectively with adolescents with learning and emotionaj. problems. The 
mean rating for each subcompetency was at High > or 5 on a scale of 1-5. 
.These ratings and accompanying suggestions were used by the competency 
area coorcy.nators/in their modifications of desired learnj.ng outcomes 
and revisions of^tatements and definitions of learning objectives. 

B. Judgment by Program Participants 

1. Intern self-evaluation of c^;rriculum competencies and compilation of a, 
form' eliciting individual reflections on their experiences are measures 
supporting the adequacy of the curriculum. Median ratings, on intern pre- 
post training self-evaluat^ion of competencies show increases of one to 
four points (on a 7~point scale) for all items. The average increase in 
median ratings was greatest for Psychoeducational Assessment,* Behavior 
Management^ and Systems Analysis* Individual reflections show the 
Interns to have increased feeling^ of professional competence, ^reatet^ 
8elf-*conf idence, and heightened self -awareness as positive aspect^ qf 
their experience. The practicum experience was cited by a^lv. as the major 
strength of the program, with positive group interactions mentioned 
second.' Coordination between seminars and ^practicum and lack of degree 
. granting authority were most often cited as weaknesses,. The following 
quote is typical of many summary remarks: feel competent and able to 
teach [adolescents with eiuotional and learning problems], and I*m looking 
forward to [the start of the school year]. I'm pleased that I*ve had the 
opportunity and have grown personally." 
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At the conclusion of training, the interns responded anonymously to ^ 
questionnaire about the instructional program. Evidence related to' 
instruction and effectiveness of instructors was presented above with 
Objective 2. Mean ratings by interns across learning areas on scope of 
seminars and amount of material covered (Item 14), difficulty of material 
(Item 15), and emphasis pladed on theoretical considerations (Item 17a) 
and practical aspects (Item ^Ll^b) were 3 #2, 2.6, 3-1, and 2.tt respectively 
on a scale ofs^ (not enough) through 3 (about right) to 5 (too much). 
Mean ratings by interns across learning areas on the usefulness of skills 
taught (Item 20) and overall value of seminars (Item 21a) were 3.5 and 
3.4 respectively on a scale of 1 (poor) to 5 (excellent). Appendix F 
shows the items md mean responses. Practicum, a, survey of schools 
(Systems Analyst"), and counseling activities were listed most frequently 
as the most effective learning experiences. 

Responses to a similar questionnaire by graduated who had participated in 
the Mark Twain Staff Development Institute were tabulated separately for 
teacher advisors and team leaders (Team Teachers, N " 20) and for physical 
education, arts, and other supporting teachers (Other Teachers, N « 16). 
The average rating on the relevance of learning areas to their role per^ 
formance (Item lA) after more than 1 year on the job was 4.1 and 3.5 
respectively on a scale of 1 (not relevant) to 5 (highly relevant). The 
groups differed markedly only on the Psychoeducational Assessment and " ' 
Programming area; team teachers rated it 4.1 in relevance, while oth6.r 
teachers rated it 2.4. This finding' is 16gically consistent with their 
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differing Job duties. When indicating how adequately they felt they were 
prepared for their jobs (Item IB), team teachers rated at 2,7 and othei;:^^ 
teachers at 3.3 on a scale from 1 to 5. The groaps- agreed that somewhd't 
tou imich emphasis was given to theory (3.8 and 3.7)> end too little 
emphasis was given to practical aspects (1.6 and 1.8) (Item IC). It must 
be noted that practicum experience was gained on the job after (not 
during) the institute since the opening of Mark IVain School for students 
followed the training program. 

In addition, institute graduat:ea indicated how competent thay felt in each 
learning area and if they felt in need of further training. The percent- 
age of teachers indicating a feeling of competence averaged 66 per cent 
for team tecfthers and 71 per cent for other teachers for each goal area. 
^ Relatively few graduates ^elt the need for additional training, ^'although 
felt need was somewhat stronger among teacher advisors and team leaders 
(Mean » 23Z) than among other supporting U^chers (ilean « HZ). Appendix 
G presents these results. 

C. Judgment by Experts in the Field 

The Maryland State Department of Education examined the curriculum of the 
1971-7^ Mark TWain Staff Development Institute and the Mark Twain Teacher 
Internship t^rogram. Both programs were accepted as leading to endorsement of 
the participants* Maryland professional certificate in the area of special 
education. ParticipantB also earned at* least 30 in-service credits for suc- 
cessful completion of these training programs. The five basic learning area 
courses — Psychological Assessment and Programming, Human Relations and Coun- 
seling, Curriculum Development and Implementation, Behavior Manageaent, and 
Systems Analysis and Consultation — were submitted to the MCPS Division of 
Career Programs for accreditation as individual in-service courses. Approval 
was granted for awarding MCPS persbnnel with three credits for- each completed 
course* 

Criteria are now being established so that a formal, comprehensive summative 
evaluation of the competency-based teacher-development curriculum can be 
accomplished by a group of outside **experts** as well as the program staff 
prior to the' end of the funding period (August, 1974). 

Discussion and Recommendations 

The primary curriculum godl of the training staff during 1972-73 was specification 
of desired teacher competencies and description of the learning activities and 
experiences needed to promote their attainment. Although learning outcomee have 
been specified in terms of siU>competencies with defining performance and behavi- 
oral objectives, clear criteria for levels of specificity of the statements are 
only partially developed. In addition, the Curriculum Development and Implementa- 
tion area has not yet established statements of behavioral objectives. 

Cyclical feedback irom participants and 'cnraluative surveys of graduates were 
solicited and used In curriculum modification. Generally, ratings obtained from 
recent graduates were more favorable than from earlier graduates, suggesting 
Improvement in the curriculum from one year to the next. The 1971-72 institute 
graduates felt xnodeiately well prepared for their jobs. The major criticism of 
thelr\training program was an over emphasis on theory and tinder emphasis on 
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practice. Thia imbalance was adjusted in the 1972-73 Teacher Internship Program 
with the requirement of over 600 tours of supervised practicum teaching. The 
adjustment is reflected in tne more balanced theory-versus-practice ratings of 
the 1972-73 interns. The 1973-74 internship Program puts still more emphasis on 
practicum with a requirement of 900 hours in teaching practice. 

The part of the preliminary evaluation plan of May, 1972, calling for formal 
sumative evaluation of the curriculum content for its comprehensiveness and 
consistency by both program staff and a panel of experts was not implemented dur- 
ing 1972-73. This is projected for 1973-74 after validating criteria have been 
established.^ Confidence in l;he content of the Mark Twain Teacher Internship Pro- 
gram^ however, is supported by the following: 

1. It is an integral part of an operating school and is planned and coor- 
dinated by a training staff actively engaged with pupils 

2. The Maryland State Department of Education examined the curriculum and 
acceptedHt as sufficient for endorsement of professional certification 
in the area of special education 

3. The MCPS Division of Career Programs has approved the basic courses for 
awarding in-service credit 

4. The major curriculum content areas were directly related by learning 
area coordinators to competencies which were perceived by practicum 
supervisors as highly significant 

5. Stated learning outcomes of the training program have a relationship to 
the conceptual models ot competency and the priorities recommended in 
the literature for teachers of exceptional childrep (See Fagen and Long, 
Mackie, et al. , and Tompkins.) 

In order to increase the effectiveness of the curriculum, it is recommended that: 

Development of explicit learning outcomes should continue with establishment 
definitive standards for statements of objectives at various levels (sub- 
competency, performance objective, behavioral objective). 

The relationship between the competency objective^ of the five basic learn- 
ing areas and competency priorities as recommended in the literature for 
teachers of exceptional children should be documented. 

Coordination should be Improved between practicum experiences and the con- 
tent and learning outcomes of seminar instruction. 

Specific criteria should be formulated for use as a standard for formal 
evaluation of progress toward the model of a competency-based teacher- 
education curriculum. 
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OBJECTIVE 4 

Program Objective 4 , 

To Implement the learning experiences and activities that will ensure participant 
attainment of competency In (1) Psychoeducatlonal Assessment and Programming, 
(2) Human Relations and Counseling, (3) Curriculum Development and Implementation, 
(4) Behavior Management, and (5) Systems Analysis and Consultation 

Evaluation Objective 4 

To assess each participant completing the training program for his competency In 
each of the above five areas 

Evidence of Attainment of Objective 4 t 

Learning sequences were presented for all five competency areas during a 41-week 
training schedule of 104 two-and-one-half-hour seminar sessions, 33 weeks of 
practice teaching, and a variety of individual projects. To accomplish the 
evaluation objective, three distinct but interdependent activities were conducted. 

A. Assessment of Intern Competency at the Subcompetency Level 

Intern assessment culminated in a final summary evaluation which indicated 
performance as Highly Effective , Effective , or Needs Strengthening for each 
of the 15 subcompetencles. All interns in the 1972-73 Mark Twain Teacher 
Internship Program completed the Internship successfully, with final summary 
evaluations of effective or better in all subcompetencles, even though some 
specific task performances were scored as weak and some data were missing due 
to absence or task Incompletlon. Table 5 shows the number of Interns in each 
evaluation category by subcompetency. 

The final summary evaluation of Interns was determined by a weight.ed integra- 
tion of ratings from seminars and practlca. Each competency area coordinator, 
using results obtained from both teacher-made tests and unstructured observa- 
tions, subjectively rated each Intern on a 7-polnt scale for each subcompe- 
tency In that learning area. At the end of each practlcum placement, super- 
4 vising teachers also rated the Interns on the same 7-polnt scale for all of 
the subcompetencles which they felt the Interns had the opportunity to demon- 
strate. The 3 ratings obtained for each intern in practlcum were averaged in 
a ratio of 1:1:2, giving the last rating twice the weight of those received in 
earlier placements. For final ratings, the practlcum and seminar ratings were 
combined in a ratio of 3:2. Adjustment in weights was made where less than 3 
practlcum ratings were used. For one subcompetency (2.3.), no practlcum rat- 
ing vas made; the seminar rating comprises the entire final rating on that 
item. 

B. Assessment of Intern Competency at the Performance Objective Level 

. The assessment of Intern performance at the subcompetency statement level con- 
stituted a summatlve evaluation. Each subcompetency, however, is further 
defined by a set of performance and behavioral objective statements. Assess- 
ment of Intern performance at that level is formative relative to competency 
attainment. The procedures and techniques for evaluation of Intern progress 
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TABLE 5 

Final Summary Evaluation of Interns by Sub competency 



Subcompetency* 


Highly 
Effective 


Effective 


Needs < 
S trengthening 


1.1 


Completion of a Psychoeducatlonal- Profile 


2 


6 


0 


1.2 


Use of Assessnent Information 


2 


6 


0 


2.1 


Effective Comprehension and Communication 


6 


2 


0 


2.2 


Effective Interaction 


6 


2 


0 


2.3 


Facilitating Humanistic Education in Groups 


3 


5 


0 


3.1 


Development of Instructional System 


5 


3 


0 


3.2 


Development of Appropriate Curriculum 


. 6 


2 


0 


3.3 


Development of Learning Activities 


5 . 


3 


- 0 


3.4 


Selection ot Appropriate Materials 


6 


2 


0 


4.1 


Establishment of Behavioral. Goals 


4 


4 


0 


4.2 


Identification of Teaching Strategies 


5 


3 


0 


4.3 


Use of Intervention Techniques 


4 


4 


0 


5.1 


Communication of Concepts of .System 


6 


_ 2 


0 


5.2 


Use of Organizational Processes 


5 


3 


0 


5.3 


Use of Consultation Process 


5 


3 


0 



*See Appendix D for complete statement of the siibcompetencies. 
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toward competency (formative evaluation) are dictated by the statements of / 
those defining objectives* Since both program and evaluation efforts are 
still In a developmental stage » Intern progress toward competency was 
assessed only In relation to those performance objectives for which method- 
ology has, been developed* Interns were permitted to recycle tasks as often 
as necessary until an adequate level of performance was reached. In some 
few instances^» by arrangement with the Instructor » less than adequate scores 
were allowed to stand when they did not reduce overall scores below an effec-* 
tlve level. However » no subcompetency>f Inal evaluation of Highly Effective 
could be reached without completion of all tasks at an adequate or better 
level. Judgment of the validity and reliability of the l^nstruments and pro- 
cedures used is presented with Objective 5. Assessment results at the 
performance objective level by competency area follow: 

1» Psychoeducatlonal Assessment and Programminf^ » 

Assessment of Intern competency on the performance objectives for psycho- 
educational assessment and programming led to eight scores for each 
intern. These scores indicated the degree of competency (strong » ade- 
*quate» or iweak) as related to six of a total of nine defining performance 
objectives. Appendix J shows the number of interns scoring in each eval- 
uation category by related pexlormance objectives and assessment tech- 
niques. Although four scores on individual task performances were rated 
as less than adequate » other performances brought final grade point 
averages up to the effective level on all subcompetencies for all Interns. 

2. Human Relations and Counseling 

Assessment of Intern competency led to 12 scores related to 6 of the 7 
performance objectives. Appendix J shows the distribution of scores. 
Although some individual task scores originally received a rating v^f less 
than ad,equate» multiple opportunities were given to meet criteria. All 
Interns averaged effective or better for each subconpetency. 

3. Curriculum Develoinnent and Implementation 

Twenty-one scores relating to 12 of the 13 performance objectives repre- 
sent the evidence collected for demonstration of competency. Appendix J 
. shows the distribution of scores. After recycling, no Individual task 
scores were rated as less chan adequate; and all Interns achieved effec- 
tiveness on the subcompetency level. 

4. B^avlor Management 

Assessment of Intern competency resulted in 11 scores. These scores Indi- 
cated the degree of competency of Interns related to 7 of the 7 perform- 
ance objectives. Distributions of scores by related performance objec- 
tives and assessment technique are shown in Appiendix J. Although 3 
individual task performance scores still were recorded as weak after 
recycling, final grade point averages rated all Interns as effective on 
all subcompetencies. 
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5, Systems Analysis and Consultation 

Assessment of intern competency resulted in 12 scores related to 9 of 9 
performance objectives- Appendix J shows the distribution of scores- 
IWo task performance scores were recorded as less than adequate, but 
effectiveness was achieved on the subcompetency level by all interns. 

Assessment' of the Impact of the Program on Attit udes and Values 

A battery of tests was administered as a measurement of the Impact of the 
training program on attitudes and values. A brief description of each instru- 
ment an<i a sutamary of median scores are shown in Appendices K and L, respec- 
tively. The Wilcuxen Matched-Pairs Signed-Ranks Test was used to test pre- 
and post-training score differences for statistical significance (Siegel, 
1956). This nonparametric test utilizes information about both the m^nitude 
and the direction of differences between pairs. 

Based on previous findings (e.g., Fagen and Long, 1971; MCPS Report on 
Institute, 1972), the following hypothes€;s were generated: 

1. A positive shift on the Minnesota Teacher Attitude Inventory , suggesting 
increased ability to interact effectively and promote mutual problem 
solving 

2. Shifts on the FIRO-3 toward more balanced and flexible interpersonal , 
behavior , 

3. A positive shift on the "Inner Directed" scale of the Personal Orientation 
Inventory , indicaE^g movement toward more of the characteristics of a 
self-actualizing individual 

4. Ihifts on the Teacher Practices Questionnaire in group role perception,^ 
with decreases in "disciplinarian" and "referrer" functions and increases 
in "counselor" and "motivator" functions 

5. Positive shifts on the Profile of Organizational Characteristics in 
ratings of organizational characteristics, indicating increased preference 
for a democratic school organization 

6. Shifts on the Problem Behavior Analysis , indicating a) anticipation of 
less frequent "Oppositional Behavior" and more frequent "Failure Follow 
Through" and b) being less disturbed by "Overt Agressive Behavior" 

7. Positive shifts on the Specialized Proficiencies for Working with Excep- 
tional Children in confidence for •'Knowing the Child," "Curriculum 
Materials and Methods," "Counseling and Behavior Management," and "Parent 
and Public Relations" and on both confidence and importmice for "Testing 
and Psychoeducational Assessment," "Teacher as a Professional Team 
Worker," and "Teacher as a Worker," indicating Increased confidence in 
their abilities and acknowledgement of the importance of these competen- 
cies 



The Speclallgtd Prof Icleocles for Working with Exceptional Children Questionnaire 
(SPQ) MOj^ administered to document the Impact of the training program on partici- 
pants* (1) confidence in their abilities In specialized competencies and 
(2) acknowledgwent of the importance of these compejtencles. This list of teacher 
competencies was developed as part of a study » Qualification and Preparation of • 
Teachers of Exceptional Childtren , conducted by the Office of Education. Some 
- modification of items and format was made. Tcble 6 shows the relationship between 
the seven sections of the test and the five program learning areas along with the 
results of the statistical testing. 

The changes in scores from^pre- to post Internship were tested using the Wllcoxen 
Matched*^Palrs Signed-Ranks test. Increases in confidence on six of seven sections 
were statistically significant, indicating positive changes in tralneea* confi- 
dence in their competencies in those areas. A significant difference was not 
obtained for .one of the sections, **Parent and Public Relations." This Is not an 
unexpected Outcome since a minimum of Wphasis during the program year was placed 
on proficiency in this area. None of the statistical tests performed was statisti- 
cally significant relative to changes- In the importance trainees placed on the 
competencies. However, median pretest scores for Importance attributed to the 
competencies were well abo^A» the midpoint of ^he scale. 

Using the Wllcoxen Test, none of ^he six additional instruments showed a statisti- 
cally significant difference In score^xfrom pre- to posttraining except in 
Isolated subscales. However, many scores were well above average on both pre- and 
posttest; anH most observed changes mjre in the' predicted direction. For example, 
the median scores for the Personal OHentation Inventory > Inner Directed (^he 
major test scale) were converted to standard scores using adult norms at about 56 
on the pretest and about 67 on 'the pos^ttest. Similarly, Minnesota Teacher Atti- 
tude Inventory median scores placed the Interns at about the 76th and 80th per- 
centiles in the pre- and post tests respectively, compared with secondary academic 
teachers with five years experience. On the Teacher Practices Questionnaire , 
scores changed in the predicted direction for the roles of 'lleferrer" and^^ti- 
vator** but not to a significant degree. 

Discussion and Recommendations 

The 1972-73 Marl^ IWain Teacher Internst)ip Program was carried to its logical con- 
clusion with all Interns reaching at least an adequate level of performance in all 
subcompetencies.. Independent validationMOf trainee performance relaUve to stated 
subcompetencies, however, was not accomplished during this program year. Evidence 
• of progress toward this long-range goal is more conceptual than the result of 
actual production and use of Instrumei^ts and devices for competency-based certifi- 
cation. That is, successful completion of the program required mastery of stated 
competencies which was determined by skilled teachers and/or tralnets th/ough 
observation in the natural setting for role performance (e.g . . classroom) and/or 
in the Instructional setting ( e.g . , seminar); and a uniform rating Instrument was 
used to obtaia Judgments. Ratings on Interns were obtained for all 15 of the sub- 
competencies ifL the instructional settlngTand for 14 of the same 15 subcompeten- 
cies in the natural setting. To Increase confidence in the final evaluation of 
Intern competency, lAiltiple ratings were pooled and were dependent upon the whole 
r'ange of experiences and data available to the rater. However » the Inclusion in 
final evaluations of practicum ratings obtained uhile instruction was still taking 
place may not be in keeping with the model of performance-based assessment. 
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TABLE 6 



Kelatlonshlp Between Learning Areas and Subtests of the Specialized 
Proficiencies for Vtorking with Exceptional Children Questionnaire with 
' Level of Significance of Change Scores for Iioportance and Confidence 



Learning Area 


Test SeQt:lon 


Significance 


Psychoeducatlonal Assessment 
and Progiraming ^ 


Knowing the Child 

Testing and Psycho- 
educational Assessment 


Importance N.S. , 
Confidence* 
Importance N*S« 
Confidence** 


Counseling and Human 
Relations 


Teacher as a Professional * . 
Team Worker 

Teacher as a Person 


Importance N.S* 
Confidence** 

Importance NtS. 
Confidence** 


and Implementation 


Methods 


Confidence** 


Behavior Management 


Counseling and Behavior 
Management 


Iiiq>ortance N.S* 
Confidence** 


Systems Analysis and 
Consultation 


Parent and Public Relations 


Importance N.S. 
Confidence N.S* 



*Slgnlf leant at the 5 per cent level. 
**Slgnlflcant at the 1 per cent level. 
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Auessmtnt of Interns relative to perforaumce and behavioral objectives, directed 
by the learning area coordinators, was implemented by the use of innovative 
teacher-made tests* Increasing use was made of behavioral formats such as role 
playing and simulation activities; %yhenever possible, behavioral demonstrations 
rather than paper and pencil tests were devised. The goal of obtaining at least 
one assessment for each behavioral and/or performance objective was only narrowly 
missed. Assessment was accomplished relative to 40 of the ^L^^erformance objec- 
tives* It should be notecf, however, that in- many cases the assessMUt techniques 
did nc'" adequately sample the behavior constituting the objective. Seme assess* 
ments did not require the trainee to ragage in producing a performance but shoved 
that he understood som behavior, concept, or principle germane to the objective. 
Formative assessment at the performance objective level had great value in provid- 
ing dlagiK>8tic teedback to students and instructors and in providing feed|back 
about the efficacy of particular segments of the teacher--educatlon program. Some 
usefulness was lost because of the scheduling of assessment periods too late in 
the instructional process and because of the opportunity to acquire skills ahd 
' understanding simultaneously through a variety of experience, especially practice. 
The cost of adequate instrumentation of performance level assessment £ould exceed 
the cost of the entire training program. 

Thm r^si^ts o1>talned from, the administration of the pre-posttest battery to assess 
the iaq;>act of the training program on attitudes and values were disappointing. 
Only the Speclallzsd Prog^ciencies for Working with Exceptional' Children Question- 
naire showed a statistically significant shift and then only in the trainees* con- 
fldence in their ability to perform specialized competencies. In several 
instances, however, scores were well above average. Greater significance was 
noted ^ tests of pff^ to post training difference^ Tor participants in the 1971-72 
Staff Dewlopment Institute, but this appears to be the result of relatively 
higher px)^tralnlng scores for 1972-73 participants* For all Instruments, the 
small ni^er of participants in the 1972-73 internship dictated a nonparametrlc 
statistical analysis; and in some instances, its lack of power could be respon- 
sible for failure to ineet the test for significance. In addition, there seemed to 
be some reluctance on the part of the Interns to be tested on attitude change.' 

In order to increase the effectiveness of assessment of attainment of competency, 
it is raconmended that: 

*i 

Consideration should be given to including only the final practlcum perform- j 
ance in the determination of compet^Hicy i 



emlnar Instructors should be responsible for evaluating competency in 
cqulring sp^eclflc knowledge and skills only at the behavioral and perform- 
ance objectives level 

. Assessment of Intern competence at the subfompetency level shduld be ac(;om- 
pllshed independently in the natural Betting of the classrodm by' trained 
observers or under caifefully simulated conditloil?* . \ 

OBJECJIVE 5 ^ ( ^ 

Program Objective 5 

To develop a functional system and methodology for evaluating knowledge, attitudes 
and skills in five specific teacher competency areas 



Evaluation Ob J active 5 

To assess coi^etency assessment techniques for vali dity, reliability, examinee 
appropriateness, and administrative usability 



/ 

Evidence of Attainment of Objective 5 

To accomplish Program Objective 5, three distinct but related activitie'J wera 
initiaied: (1) the developnent of procedures and techniques for an independent 
• validation of trainee performance as specified in each subcompetency statement; 
(2) l^ie development of procedures and techniques to assess trainee attainment of 
stated performance objectives? and (3) the development of a battery of r its to. 
assess, the impact of the training program on attitudes, values, and general 
knowledj^e ^>f participants* 

At this jVoint in the development of the curriculum and of the evaluH^lon method- 
olo^, progress toward meeting Objective 5 is shown 1^ the. extent^of the evaluation 
effort, that is, the attempt made to obtain some i^ex of the expected performance 
even if that index could not be considered adequate for d^onstr^tion of the stated 
objective* ^ L 

A. Techniques for Validation of Competency Attainment ^ 

Validation of trainee performance as specif ied^ by, each of 15 1 subcompetency 
stateronts was accomplished using 'the Intern Evaluation Form ^o^e Appendix E) • 
Use ot this instrument brings with? it the usual liuitations df rating proce- 
dures such as a generosity error, differences in rater standards, halo error, 
a]d>iguity in^aning of attributes to be appraised, and instability and 
unreliability of human judgment. Between-rater reliabilities weVe not estab- 
lished; studies have shown repeatedly that correlations of ratings by two 
- independent raters ^are generally low.. The content and Construct validity of 
the instrument must be based on the face validity of thfe items. Since there t 
ia no objective means of evaluating these face validities, interpretation la. 
strWtly subjectl^. ' " 

B. Td^hniques for A^essment of Skill and Knowledge Attainment 

The procedures and techniques used for skill and knowledge assessment were 
reviewed by the evaluation staff, and the tnatch between Instruments and 
behaviqral objectives was made explicit. Techniques then we^e submitted to an 
"outside expert" for evaluation. Criteria used for judgment were developed by 
the Center for the Study of Evaluation, UCLA, and reported in Elonentary 
' School Test Evaluatiojig (1970). A copy of the evaluation instrument is * ^ 

included in Appendix H. Table 7 shows the instruments submitted for evalua- 
tion and the ratings received on each ^aspect of. the criterion. On each cri- 
terion, a technique could earn a specified number of points. "Total Grades" 
^ presented for measurement validity, examinee appropriateness, and administra- 

tive usability are simply the total number of points earned in each criterion 
category. Since the instruments used were ad hoc and were not sutjjected to 
the routine procedures for test devfelopment, certain categories w^re not 
ratable and are Indicated as such in Table 7. Occasional omissioA of ratings 
on a remaining aspect of the criteria resultedln an inability to determine a 
category .total for that Instrument. Comparisons among instruments* however, 
can be teade by criterion where instruments received total grades. Brief 
description's of these Instruments cai^ be found in Appendix I. 
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C. Techniques for Measurement of Changes In Attitudes, Values, and General 
Knowledge 

A battery of tests was administered pre- and post training to document the 
Impacf; of the program on thW attitudes and values of participants. The 
specific purpose (educational objective) for each instrument was made explicit* 
These instruments also wwe submitted to an "outside expert" for evaluation 
and evaluated against criteria developed by the Center for the Study of Eval- 
uation (see Appendix M) . Table 8 lists the tests used and shews the ratings 
they received for each aspect of evaluation criteria, using the scale sug- 
gested by ^E: ,^ood, 12-15 points; fair, 8-11 points; and poor, 0-7 points* 
Appendix K provides a brief description of each test -as well a<<^ its intended 
meajsurement purpose. 

Discussion and Recommendations 

The ideal criteiion against which teacher competency might be appraised consists 
of a systematise analysis of the level of outcomes achieved by the teacher with 
pupils he tear^hes over relatively long periods of time (at least two years). 
According to Rosuer (1972), demonstration^ of change in teacher competency under 
actual classroom conditions is the most appropriate level for accountability in 
teacher education* Teacher education, however, does not yet possess the neces- 
sary instruments to measure change in specific competencies (Rosner). Assessment 
of teaser competency under actual classroom conditions, where it is attempted, 
is reduced to the use of an observation system (e.g., Flanders) or, as in this 
case,.) the use of rating scales. The following steps can be taken to Improve the 
reliability and validity of rating procedures: more explicit statements of 
desired , behavior, criteria to judge the presence or .absence of that behavior, 
and the training of p^sonnel used as raters. 

While the present state\of instrumentation for classroom observation greatly 
hampers appropriate acico\mtability in teacher education, methodology for the 
instrumentation of assessment techniques addressing knowledge and skills under 
simulated conditions is more ^advanced. Although some degree of realism is 
sacrificed, great gains are made in the control over possible random variation in 
all aspects of the situation. Therefore, to increase reliability, both method- 
ologies should be used. To that end. Instrument A, developed during the earlier 
six-month institute, was used on an experimental basis a^ an independent valida- 
tion of Subcompetency 1.1 (ability to complete a psychoeducational profile, 
evaluating... interpersonal functions). The instrument was developed to present 
a simulation of role performance; however, the mechanics of administration, the 
time required to complete the test, and t^e scoring procedure are in need of 
considerable revision. The instrument did not differentiate among interns nor 
did it show changes from pre- to postadministratign. 

The procedures and techniques used for evaluation of intern progress toward com- 
petency- by acquisition of specific skills and knowledge were dictated by the 
statements of performance and behavioral objectives. A total of 37 different 
assessment procedures or techniques were used during the program year to obtain 
"scores" on trainees. Ten of the procedures were intended primarily as learning 
activities— the acquisition, not demonstration, of knowledge or skill. These 
procedures were classified as "Graded Learning Activ,ities" and were not submitted 
for evaluation. In addition, several assessment techniques were not clearly docu- 
mented and not available for evaluation. The remaining 20 instruments (listed in 
*Table 7) were evaluated by an "outside expert" for validity, examinee appropriate- 
ness, and administrative usability. 
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TCST NAME 



Sp ecialized Proficiencies for 



Working with Exceptional 



Children Questionnaire 



Fundamental Interpersonal Rela- 



tions Orientation - Behavior 



Minnesota Teacher Attitude 
Inventory 



Teacher Practices Queationnaire 



Profile cf Organizational 



Characteristics 



Personal Orientation Inventory 



Problem Behavior Analysis 



MrAStRlMENT 
1 VA I 1 PIT Y * 



r>; n 

0 ' e 

3*9 



neX A MINCE 
A P P R O P R I A T E NESS 



Compr** 



6 0 



IF 



•.2 ••! 



11 



3 3 11 1 1 



3 3 12 12 



3 ' 3 2 2 1 2 



3 3 10 1 1 



3 1110 



3 4 1 2 11 



3 3 10 11 



III 



ADMINISTRATIVE USABILITY 



Adminittrafiof) 



it 



ImcrprtUtion 



; 3 



2 10 10 11 0 12 



211 210-002 



211 2112012 



2 1 1 2 0 1 1 0 0 1 



2 1 1 2 0 0 1 0 0 1 



2 1 1 2 112 10 3 



211 1011012 



*Rated aj^alnst purpose stated by program staff **Scale: Good, 12-15 pointsr 

(see Appendix K) ?air. 8-11 poln ts 

-Could not be rated Poo^t ^ P°i"«^« 

Reproduced from CSE Elementary School Test Evaluations, Ralph Hoepfner, et^ al , , p> >xvi* 
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9 1 



NOKMED TECHNICAL 
;V EXCELLENCE 



TOT A L 
CKADES 



icies for 



tional 



0-1 o.i 0-1 O'l e.i 0-1 0-1 0-1. o>L.lil 



Q.} o-v Or^^^JO^^^ 



I II 



dire 



lonal Rela- 



Behavior 



:itude 



itionnaire 



3 3 1 111 



2 10 10 1 10 12 



0 0 0 0 2 1 



G F y p 



3 3 12 12 



2 11 2 1 0 - 0 0 2 



13 0 12 1 



F G P F 



3*32212 



211 2112012 



0 3 0 1 2 2 



F G G F 



3 3 ' 1 y 1 1 



2 1 1 2 0 1 1 0 0 1 



0 2 0 0 2 1 



P F P P 



.onal 



Inventory_ 



.ysia 



3 11 1 0 



2 1 1 2 0 0 1 0 0 1 



0 0 0 0 0 0 



P F P P 



3 4 12 1 1 



2 11 2 112 10 3 



1 1 0 0 3 2 



G G G F 



3 3 10 11 



2 1 1 1011012 



0 3 0 1 2 2 



P F F F 



\i O i by prot^ram staff 



**Scale: Good, 12-15 points 
cni/^ Fair, 8-11 poin ts 

Poor, 0- 7 points 
Lleaentary School Test Evaluations, Ralph Hoepfner, et^ al « t P» xvi. 



In dtttrmlnlng MASument validity, the question asked by the evaluator was, 
**Does this teat appear to aeaaure the specific behavioral objectlve(s) as listed 
In the statenent of program outcomes?** Eleven of 20 instruments were given a 
rating of 10 on a scale of 0 to 10; the behavior assessed by the test matched the 
behavior defined by the statement of the objective* Four Instruments received 
validity ratings of 4 or less* The reason cited for three of four low ratings 
was that the test was a demonstration of knowledge while the objective called for 
a demonstration of skill* In the other case, the test (Instrument Z) only 
addressed a very small sample of a rather large set of generalized skills called 
for by the objectives* However, given the limited resources and time available 
for test construction, the limitations observed are understandable* In general, 
the tests rated high were based on specific behavioral objectives; the tests rated 
lower attempted to measure a relatively wide spectrum of behaviors* \ 

Examinee appropriateness was determined by subjective ratings obtained In answers 
to three questions: (1) Is the cooqprehenslon level, both of Items and Instruc- 
tions, correct for the age and educational level of examinees to whom the test 
is directed?^ (2) Is the test printed. and organized for ease of the examinees, or 
* is taking the test a test in Itself?; and (3) Is the response procedure simple 
and direct for the examinee? With a total of 13 possible points, ratings ranged 
from/6 to 10 with the mode at 9* **Total Grades** for examinee appropriateness 
could not be presented on 9 instruments (see Table 7)* Ratings not obtained 

prinprily because the test node ( i*e * , videotape and/or verbal instructions) did 
not /lend Itself to objective evaluation techniques within the framework of'prac- 
tlcal considerations* Generally, examinee appropriateness was rated favorably* 
The^e was no trend observed across the Instmments in any one aspect of the 
crJ/terlon* 

Administrative usability of instruo^ts was determined by subjective ratings based 
on the^ following questions: (1) Is the test easily and conveniently administered? » 
(2) Can the test be easily and reliably scored?, (3) Is the score Interpretation 
pimple?, (4) What qualifications must the score interpreter have?, and (S) Can 
declelons be made or aided on the basis of the scores? With a maximum score of 11 
points possible, scores ranged from 3 to 9* The two aspects of the criterion 
receiving the lowest ratings across instruments involved administration* Instru- 
ments, with some exceptions, were designed for small-group or individual admlnls- 
traRon and/or required a relatively long time (over 30 minutes) for completion* 
This, however, may be the price necessary for adequate competency evaluation* 
Although the assessment was imple. ted without major problems, the resources 
required for administration were great and, If class size Increases appreciably, 
may exceed the amount available* Scoring was another area of weakness* Compared 
to the average published standardized achievement test, scoring In many cases was 
subjective and complicated* However, the tests used were far removed from the 
traditional paper and pencil multiple choice modes; and scoring methodology, of 
necessity, was more complicated* Still, there Is much room for improvement, 
especially in specification of criteria and delineation of explicit test behaviors 
^ which meet those criteria* 

Evaluation of the Instruments* m>rmed technical excellence was not done* Since 
these Instruments were locally developed and still are being considered for revi- 
sion, evaluations oty the fourth criterion suggested by the rating form were not 
considered appropriate. 



The tests* lised to document the Impact of the program on the attitudes and values 
of participants also were 'subjected to evaluation against the same criteria as 
reported above* Evaluation of content and construct validity was based on purpose 
ot Intent of the user as specified by the program staff (see Appendix K)*' Ratings 
-on measurement validity ranged from 6 to 12, with a maximum of 15 possible* Using 
the grade criteria suggested by CSE , four of the seven Instruments received a 
grade of fair or better (see Table 8). 

The major difficulty In validity was the problem of adapting the standardized test 
to the specific objectives of the program* In some Instances the match was good, 
but In others the discrepancy was very evident* It Is clear from the evaluation 
,that some of the Instruments are not appropriate; more careful selection of avail- 
able standardized Instruments should be made* 

Evaluation of the Instruments for examinee appropriateness resulted In high rat- 
ings* Not one was graded "poor«" Overall, the tests were judged appropriate for 
the trainees in terms of comprehension level and format* 

Evaluation of Instruments for administration usability resulted in fair or good 
grades* Admlxflstratlon and scoring generally were rated high across instruments; 
the area of test score interpretation presented difficulties and somewhat lowered 
test grades* Specif lcally» the norm range was often restricted; and normative 
groups were local » outdated, or poorly sampled* Also, the score interpreter often 
had td be a psychometrlst* However, even with thesi^ limitations, grades obtained 
on instruments for administrative usability were generally positive* 

All Instruments in the test battery showed a relatively poor level of normed 
technical excellence* Not one instrument received a grade of good, while 3 
received a grade of poor* Two of three Indices of reliability, stability Xtest- 
re-test) and alternate forms, were generally not reported or were less than *70 
across Instruments. In addition, few of the instruments ^reported normed scores 
obtained under repllcable conditions* Reliability coefficients addressing inter^ 
nal consistency were generally reported and were most often above *80* Test 
score distributions also seemed to have an adequate range* Normed technical 
excellence is generally a problem with educational tests because norm samples 
usually are restricted and follow-up studies are rare* The expense and effort 
necessary for thorough evaluation of Reliability, validity, and standardization 
are generally lacking* A more careful selection of standardized instrument£t, 
however, may help to overcome some of these limitations* 

Finally, with regard to the value of/ the pre-post procedure in general, it jjust be 
concluded that the variables measured are poorly defined, the error of measurement 
large, and the size of the sample sti^ll, putti:^ the validity of the results 
greatly in question* In addition, scudies have repeatedly shown that attitudes 
and opinions change only very slowly over long periods of time; and the reliability 
of instruments for measuring them is low* Since the program deals with a carefully 
selected population of successful, experienced, and committed teachers, it may be 
unrealistic to look for significant positive changes in the already high levels of 
the valued attitudes* Therefore, little may be gained from the use of pre- and 
posttesting as now Implemented* A possible use might be made of them in combina- 
tion with objective achievement tests since change in cognitive level is more 
readily measureable. _y 
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To incrutse the effectiveness of the assessment of changes in knowledge, attitudes, 
and skills of p^ogranr participants, it is recommended that: 

Resources should be focused on the development of* a limited number of quality 
assessment techniques carefullyN||elected for their appropriateness to program 
objectives " T . 

Procedures should b& established f^ evaluation of all instruments prior to 
their use \ 

Re^consideration should be given to tlve use of the pre-post test battery 
assessing changes In attitudes and valines 

Training sessions should be held with pra<iticum (field) supervisors in the 
use of the Intern Evaluation Form \ 

OBJECTIVE 6 \ 

Program Objective 6 . \ 

To^ Increase the number of trained personnel serving handicapped children 
Evaluation Objective 6 



To determine if personnel completing the training program are effectively ^ervin^ 
emotionally handicapped children and are utilizing learned competencies . 

* >. , 

Evidence Toward Attainment of Objective 6 

A, Graduates of the 1971-72 Staff Development Institute 

The teaching staff of the Mark Twain School completed a slx-mo^th training 
program f rior to the opening of the school and received supp^lementary certi- 
fication as special education teachers. For the 1973*-74 school year, 32 of 
37 original staff members are continuing in Mark Twain Programs. Three are 
on leave to further their education* two of whom are acquiring advanced 
degrees in special education. One moved from the area and is still employed 
in special education* and another is employed a& a 10-^on|:h regular' classroom 
tocher* 



B. Graduates of the 1972-73 Teacher Internship Program 

All eight interns successfully completed the program and received supplemen- 
tary certification ai? special education teachers. Seven accepted anplo3rment 
for 1973-74 in Mark iVain Programs: one as a teacher in Mark Twain School 
and six as student resource teachers in Marl^ Twain School- Based Programs. 
The eighth graduate accepted employment unrelated to working with exceptional 
children. 




Discussion and Racommendations 



Assessment of the significance of the Mark IVain Staff Development Institute in 
providing for the entry of 37 teachers into the field of special educatibn mu^t 
be with the understanding that the immediate purpose of the institute was to pre- 
pare a staff for Mark IWaln School. Institute participants had all been hired by 
MSPS with Mark Twain School as their specific job assignment. They were on full 
salary during the six-month training period. It is significant, however, that 
only five of the Institute graduates chose to leave Mark Twain School after one- 
and-one-half years of ^erience teaching in the school. Those who left did so 
for a variety of personal reasons, not because of dissatisfaction with teaching 
exceptional children, r 

While the institute goal was to prepare staff for teaching children with learning 
and emotional difficulties at Mark TWain School, the Teacher Internship Program 
. addresses the long-range goal of establishing Mark Twain as a staff development 
center for the entire MCPS educational community. Th^ 1972-73 Internship Program 
successfully contributed to attainment of that goal by enabling eight teachers to 
receive intensive training in supplementary education. Upon graduation, seven of 
these teachers accepted positions in suppl^sentary education programs, six in 
Nark Twain School-Based Programs and one in^Mark IVain School. 

Whilfe it is evident that the Mark Twain Teacher Internship Program is increasing 
the number of trained teachers serving adolescents with special needs, evidence 
is not yet available on the extent to which graduates are using their learned 
competencies. This will be obtained through ratings of job performance by their 
supervisors.^ Since the first 37 graduates comprised the original teaching staff 
of Mark Twain School, it was^not feasible to place the great burden of making 37 
ratings on one principal. 

In order to contini^e assessment of the goal of staff cjevelopment , it is recommended 
that: 

Supervisors' ratings of graduates of Mark Twain Teacher Internship Programs 
should be obtained to determine if they are using their learned competencies 
effectively to serve emotionally handicapped children 

Longitudinal study of graduates* job placements should be continued 



IV. SUMMARY 



The Mark TWain Teacher Internship Program is in its second year of operation as a 
Montgomery County Public Schools program for the preparation of personnel to teach 
adolescents with special\ needs. The program was preceded by the Mark Twain Staff 
Development Institute which trained fche staff of Mark Twain School, a Montgomery 
County, Maryland, public school providing an intensive short-term program for 
adolescents of at least average intellectual potential who are having learning and 
emotional difficulties. 
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Tbi •lx--moiith Ixistltutt d«fV€loped the basic teacher-training curriculum and 
format on vhlch the lO-mbnth Internship has been built. The program* has .been 
partially funded through FY 74 by the USOE Bureau of Education for the Hax^i- 
capped • lu primary goal is to test "the feasibility of establishing a' teacher- 
development center ^within operational public school programs tbr adolescents. with, 
special needs and [pr/ssents] an alternative [to the university] for attracting 
and preparing man{h>wer foir education of youth facing sei;iou8 problems of living." 
(Proposal; May 1972) 



Six pKogram objectives were identified to n^et ^the primary ^oal. These were 
reviewed to develop clear statements and definltioniB of progress toward their 
attainment. Correspond |.ng ev^uation objectives » with evidf^nce acceptable to the 
progrma staff as as the activities and tasks rysquired to obtain it, have 

been* specific. 



The purposes of evaliiation of the Mark Tvain Teacher Internship Program are to 
provide appropriate and' timely information (1) during" the year for f^ision and 
modification in planning^ ahd development (fo^tive evaluation) and (2) at the 
end of iach year and/or major sequence so that Judgments can be qade with rega'cd 
to trainee competencies, effectiveness of training, and progress tomrd develop- 
ment of th^ prototype program (summative evaluation). i . V 

PROGRAM DESCRIPTION " . ^ . ( 

A ■: • ^ 

Mtsrk TWain Programs, including Mark IVaip School and its ^telltte programs in 
other public schools, »ovide the setting* for the Hark Twain teacher Internship 
Program. The internshii program is a 10-month' ifb^-t'ime experience including- 
seminar s-> practice in >Mrk T%i^ix^ School>hnd School-Based Programs in selected 
other MCPS schools, and individual projects. A large number of area public and 
private facilities providing specializwl educationaiy therapeutic, and residen- 
tial services are available for site visits. The Montgoijiery County Public Schools 
Curriculum Library and Instructional -ilaterials Center are resources also available 
to trainees^. 

Training is structured on a performance-based model requiring participants to ^ 
demonstrate competency in (1) Psychoeducational Assessment and Programming, (2)* 
Human Relations and Counseling, (3) Curriculum Development and Implementation, 
(4) Behavior Management, and (5) Systems Analysis and Consultatioy. \ 

The strategy for Mark xw&in Teacher Internship Program staffing also revolves 
around the concept of competency areas. Each competency area is coordinated by 
a member of the Mark Twain Programs staff who has responsibility for. developing 
and implementing learning experiences in his area. While visiting consultants * 
and guest lecturers make an important contribution, Mark Twain Programs staff 
assume the primary training responsibility. There are presently about 80 profes- 
sional staff within Mark TVain Programs. During 1972-73, 47 qf them participated 
actively in the program as planning staff, learning area coordinators, instruc- 
tors, and/OiT prac^icum supervisors. In addition to these "In-Service Consultants," 
21 outside expwts were called in for presentations in their special fields. 
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The !^rk T^ifln !l^cher Internship Program for 1972-73 had a total of S^partici- 
pa|it8 selected from among 21 appll9ant8. Ihe group Included six women and two 
men whose prior cJl^ssMoni experience ranged from less than one to nine years. Six 
Vof \he eight Interns were teaching in Montgomery County Public Schools prior to 
'T^* ailtry into the program. The rif;^iarous and detailed selection procedures developed 
/ ' fcrr the e&rlier Mark TWain Staf/ Development Institute were used again. These 

included a review of multiple sources of information on, applicants and group and 
\ iiRensive individual interviews. 

The curriculum of the 1972-73 Mark TWain Teacher Internship Program was based on 
\ 10-month full-time learning eaqperience^with an Integrated schedule of seminars, 
practice, and Individual projects. Seminar Instruction in the five basic learn- 
ing areas consist^ of a total of 104 two-and-one-half-hour sessions under the 
direction of the competency area coordinators. Practicum experiences provided 
supervised applied learning situations. Interns completed at least 600 hours^f 
practice teachingCln both Mark IVain School and Mark Twain Programs based In 
other Montgpmery County schools. In addition, all interns participated in a 
practicum in techniques to facilitate human relations in order to promote 
Increased self<~acceptance and self-awareness. Each intern also was required to 
coaq>lete two Individual projects in areas of study which were particularly suited 
to his personal needs and interests. 

The 1972-73 internship was divided into four learning sequences, an initial five- 
week sequence and three ll^eek sequences. Each 11-^eek sequence was followed by 
a one-week period of review and evaluation* Numerous procedures, including per- 
formance on validating tasks, tests, outside assignments, and rating by practicum 
supervisors, were used to assess intern attainment of competency. In addition, a 
functional system was developed to evaluate the effectiveness of the program so 
that discrepancies between objectives and processes could be identified and modi- 
fied. Instruments were" developed to test the validity of the program and its 
relevance to the performance of various roles in the teaching of adolescents with 
special needs 

EVIDENCE OF ATTAINMENT OF PROGRAM OBJECTIVES 

Six program objectives were identified to meet the program goal of establishing 
Mark Twain School as a specialized teacher-development center within operational 
public school programs for adolescents with special needs. Evidence of the 
attainment of these objectives serves as the basis for the, evaluation of the Mark 
IWain Teacher Internship Program. Progress has been made toward meeting all 
objective. 

Attainment of Objective 1» identification and establishment of a teacher education 
faculty, was assessed by the professional preparation and previous experience of 
the staff, weekly intern feedback, and ratings of staff effectiveness by program 
participants and graduates. As yet, qualifications needed to perform specific 
duties have not been determined. However, the extensive training and experience 
of the faculty was documented. Weekly intern feedback was generally positive and 
offered useful data relevant to the effectiveness of instruction. Ratings of 
staff effectiveness were generally favorable, with slightly higher ratings for 
instruction in the courses most completely developed toward the competency-based 
model. It has been recommended that duties and responsibilities of faculty, 
including practicum supervisors, should be more clearly described; qualifying 
criteria for faculty positions should be completely described; cr iter la ^ should be 
established to judge the quality of performance; and pay for practicum supervi-" 
sion should be considered. 
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Fetalbillty and effectiveness of recruitment and selection procedures (Objective 
2) were assessed by^the number of applicants and the quality of the interns 
selected. Recruitment procedures were jiMiged«to be less than satisfactory since 
they resulted in fewer than the ten paiticlpants required by the evaluation 
objective. Withdrawals reduced the number of viable applicants. Financial con- 
siderations and lack of a degree-granting authority were significant deterrents. 
The selection process, while resulting in the acceptance of only eight Interns, 
was judged to be comprehensive and effective since all trainees successfully com- 
pleted the demanding program. Recommended are earlier and expanded recruitment 
efforts, determination of the feasibility of defining a target audience, and 
exploration of possibilities for obtaining a degree-granting authority. 

Attainment of Objective 3, development of a competency-based curriculum was 
Judged by program staff, partic^ants, graduates, and experts in the field. Fir- 
teen teacher-desired subcompetencies defined by performance and behavlo»l objec- 
tives were specified, with a description of the learning activities r^^red tq 
promote their attainment. Program participants responded to a questionnaire which 
Indicated their increased feelings of professional competence,- greater self- 
confidence » and heightened self -awareness after training. The practicum experience 
was cited as a major strength of the program. The Maryland St^te Department of 
Education approved both the Mark Twain Staff Development Institute and the Mark 
IValn Teacher Internship Program for 30 in-service credits and supplementary 
certification in special education. In addition, MCPS has accepted the five 
basic sonlnar courses for in-service *^r edit. Recommended are continued develop- 
ment of explicit learning outcomes with definitive standards for scatement of 
objectives at various levels; documentation of chc relationship of learning objec- 
tives to competency priorities recommended in the literature for special education 
teachers; improvement of coordination between practicum experiences and seminar 
instruction; and foxmilation of criteria for evaluating progress toward the 
development of a competency-based teacher-developmeut curriculum. 

Objective 4, attainment of Intern competency in the five basic learning areas, 
was assessed at the subcompetency level aud at the performance objective level. 
All interns completed the program successfully, with final summary evaluations of 
effective or better in all subcompetencies. Intern evaluation was based on a 
weighted Integration of ratings of performance in seminar and three practicum 
settings. Adequacy of performance of specified tasks related to performance and 
behavioral objectives in each of the five learning areas constituted formative 
evaluation. Although some individuals* performances on specific tasks were less 
than adequate, final grade point averages for all interns were effective or better 
for all subcompetencies. In addition to competency oassessment. Impact ^ the 
training program on the interns** attitudes and values was measured by a battery of 
pre- and posttests. Little change was noted from their beginning high levels of 
the attitudes usually associated with successful teaching of pupils with speciax 
needs, .j^ept in the significantly Increased confidence of the interns in their 
ablli^^ work with these students. Recommendations are that only the rating of 
P^^^V^W^^ the final pracf.cum placement should be included in the determina- 
tion p^^i^peteacy, s«ninar Instructors should be rdiponsible for evaluating com- 
peteney^ln acquiring specific knowledge and skill only at the behavioral and per- 
formance objective levels, and assessment of intern competence at the sub- 
competency level should be accomplished independent of if ♦■ruction and in the 
natural setting of the classroom by trained observers or u^Jer carefully simulated 
conditions. , 




* Development of a functional syste^p and methodology for, evaluating knowledge, atti- 
^ v' . tudefe,. ^nd skills In t}ie f ive '(^ompeC^ncy areas is Objective 5. Attainment of this 
Qbjefetiv^ was. assessed by evaluating^ the techniques* used for validation of com- 
petency attainment ,* the techniques used for assessment of skill and knowledge 
' attainment, and the techniques us^d fof measurement of changes in attitudes, 
values, and genera^knowledge. 'Classroom observations using rating ^cales indi-^ 
Gated the need for morei^explicit behlvioral statements and criteria lEar Assessment, 
. ^ as well as the need f of 'training 4f the raters. Us>^ of a, combination of Varied 
y - methodologies is^ te<^oj™ended to increase reliability. Attainment of skill and 
i Jcnowledg^ atfs^as"l&d by 37 different instructor-devised techniqtxes^, 20 of which 
' i' were evaluated for valiaity (more than h^f received tfie high-^st, rating) ^ examinee 
appropriateness (generally favorable), and ai^ministrative usability (extensive' 
resources req4ired wiich may be necessary for competeiliy assessment.). T^iese^ests 
Xrere not evaluated for normed technical excellence. Tests used to docum^t «tti- 
>5-J '1/ ' tude and valur change also were evaluated for validity (some instruments were • 
poorly matched to , objectives ) , examinee appropriatpness (high ratings), and 
administrative usability (generally positive). These instruments showed a poor 
'level of normed technical excellence. 



The pre- and posttesting procedure on attitudes and values added little to what, 
was already known about the carefully selected group of successful teachers, 
participating as interns. ' Recommendations are that resources should be focused 
on. developing a limited nunfcer of appropriate hig>r quality assessment techniques, 
procedures should be established Vor evaluating instruments prior to their vi^e, 
reconsideration should be gixxen ti the use of attitude and value pre- and po«- 
testing, and training ^ssions in the use of the Intern Evaluation form should be 
held with practicum supervisors. 

Increase in the number of trained personnel serving handicapped children (Objec- 
tive 6) \ja8 assessed by reviewing employment placements of the graduates of the 
1971-72 Staff Development Institute and the .1972-73 Teacher Internship Program. 
It is considered ..significant that in winter, 1973-74, 32 of the 37 Institute 
graduates were still employed in the job for which they *^ere» trained; and 7 of , 
the 8 Internship graduates were working with exceptional childrfenV It is reil^m- 
mended that supervisors* ratings of internship graduates should be obtained to 
determine the extent to which they are using their learned competencies and that 
longitudinal study of all graduates* job placements should be continued. 

In conclusion, significant progress has been made in the Mark Twain Teach'*T* 
Internship Program toward the mission of training educational personnel to teach 
adolescents with special needs. Montgomery County Public Schools, by directing 
Mark Twain Programs to develop teachers for supplementary education of adoles- 
cents with learning and emotional difficulties, has provided a mechanism for 
self-renewal and created a viable alternative to the university system of higher 
education for teachers. j 
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OONTIMUUM PROGRAMMING: A BLUEPRINT FOR MEETING EDUCATIONAL N 




Level 7 : Specialized Facilities - 
Nonpublic School 

Pupil needs more protective or aore 
intensive education setting than can 
be provided in public schools. (Day 
or resident lAl program) 



Level 6: Special School 
Pupil receives prescribed program under the 
direction of a specially trained staff In a 
specially designed facility within the, public 
school system. (Day Program) 



Level 5: Rill-tlme Special Class 

Pupil receives prescribed program under the direction of 
a special class teacher. 



Level 4: Regular Classroom and Resource Room 
Pupil receives prescribed program under the direction of the 
lar classroom teacher; In addition, he spends time in a specla 
staffed and equipped resource room. 

Level 3: Regular Classroom with Supplementary Instruction and Serv 
Pupil receives prescribed program under the direction of the regul« 
room teacher; in addition, he receives supplementary Instruction or 
from an itinerant or school-based specialist. 

Level 2: Regular Classroom with Consultation to Teacher 7 
PjipiJ^ receives prescribed program under the direction of regular classro 
who is supported by ongoing consultation from specialists. 

Level 1: Regular Classrooms • 
Pupil receives prescribed program under the direction of the legular classrooi 



ooNnmniM fsogi^amming: a blueprint for meeting educational needs 



Level 7: Specialized Facilities - 
Honpubllc School 

Pupil needs more protective or iBore 
intensive education setting than can 
be provided in public schools. (Day 
or residential prograa) 

Level 6: Sjeclal School 
Pupil receives prescribed program under the 
direction of a specially trained staff in a 
specially designed facility within the. public 
school system* (Day Progrssi) 

Level 5: FUll-tlme Special Class 

Pupil receives prescribed program under the direction of 
a special class teacher. 

Level 4: Regular Classroom and Resource Room 
Pupil receives prescribed program under the direction of the 
lar classroom teacher; in addition, h^ /Spends time in a specially 




staffed and equipped resource room* 



Level 3: Ref^lar Classroom with Supplementary Instruction and Service 
Pupil receives prescribed program under the direction of the regular class- 
room teacher; in addition » he receives supplementary instruction or service 
from an itinerant or school-based specialist. 

2: Regular Classroom with Consultation to Teacher 
receives prescribed program under the direction of regular classroom teacher 
s supported by ongoing consultation from specialists* 

tegular Classrooms 

ives prescribed program under the direction of the regular classroom teacher. 



APPENDIX B 

Facilities Visited by Mark Twain Teacher Interns, 1972-73 



SPECIAL EDUCATION 

ft 

Glaydin School, Leesburg, Virginia 

Leary School, Falls Church, Virginia 

Anne Arundel Learning Center, Annapolis, Maryland 

Christ Child Institute for Children, Rockville, Maryland 

Comnunlty Psychiatric Clinic, Bethesda, Maryland 

Chestnut Lodge, Inc., Rockville, Maryland 

COMMUNITY ORGANIZATIONS 

Boys* Home of Montgomery County, Inc*, Wheaton, Maryland 
MCPS Office of Community Affairs, Rockville dryland 
Karma House, Rockville, Maryland 
Roving Youth Leaders Program, Rockville, Maryland 
Second Mile Runaway House, Hyattsville, Maryland 

Mental Health Association of Montgomery County, Kensington, Maryland 
YHCA Listening Post, Bethesda, Maryland 

Montgomery County Health Department Drug Program, Rockville, Maryland 
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Staff of Mark Twain Teacher Internship Program, 1972-73 



PRACTICUM SUPERVISORS (LEVEL 2) 

Mark Twain School Staff 

Jackie Bylsma, Teacher /Advisor 

Laura Flainii Teacher/Advisor 

John Gannon, Teacher /Advisor 

Roger Geasay, Team Leader 

Dick Knight, Teacher /Advisor 

Mickie Kottage, Team Leader 

Eleanor Lautenschlager , Teacher /Advisor 

Chudk Sawchenko, Support Teacher 

Jane Schiagall, Support Teacher 

John Schneider, Team Leader 

Marefe Sneed, Teacher /Advisor 

Shirley Turnage, Teacher /Advisor 

Tom Wallace, Teacher/Advisor 



School-Based Staff 

Why la Beman, SRT 
Judy Billman, SRT 
Louise Brown, SRT 
Ellen Congleton, SRT 
John Fisher, SRT 
Martha Fohrell, SRT 
Dor it Geurtsen, SRT 
Jim Hutcheson, SRT 
Rita Mann, SRT 
Terri Martinelli, SRT 
Carol Neill, SRT 
Mark Ravlin, SRT 
Mary Reeves i SRT 
Jack Robinson, SRT 
Sidney Shore, SRT 
Mike Vizas, SRT 
Pat Wright, SRT 
Sharon Yoerg, SRT 



SEMINAR INSTRUCTORS (LEVEL 3; IN-SERVICE CONSULTANTS) 



Mark Twain School Staff 

Bev Babcock, Teacher/Advisor 
George Brown, Psy<:hiatr ist 
Jacqueline Bylsma, Teacher /Advisor 
Mary Dunbax, Support Teacher 
Stanley Fagen, Supervisor, Staff 

Development 
John Gannon, Tc^acher/ Advisor 
Roger Gesssly, Team Leader 
Jeffrey Hill, Teacher /Advisor 
Roslyn Inman, Staff Development 

Specialist 
Steve Johnsen, Psychologist 
Mark Kelsch, Support Teacheii 
Phyllis McDonald, Coordinator 
Edmund Phillips, Supervisor, 

Supplementary Services 
William Porter, Principal 
Jane Schiagall, Support Teacher 
John Schneider, Team Leader 
Judith Tarr, Support Teacher 



School-Based Staff 

Why la Beman, SRT 
Ellen Congleton, SRT 
Maxine Counihan, Program 

Specialist 
Dor it Guertsen, SRT 
James Hutcheson, SRT 
Richard Mainzer, SRT 
Rita Mann, SRT 
Terri Martinelli, SRT 
Geraldine Meltz, Supervisor, 

School-Based Programs 
Carol Neill, SRT 
Joan Peck, Psychologist 
Mark Ravlin, SRT 
Jack Robinson, SRT 
Sidney Shore, SRT 
Pat Wright, SRT 
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Outside Consultants 

Jane Bernot, Department of Physical Education, Montgomery College 

Patricia Bourexis, School of Education, University of Virginia 

William Coviello, Maryland State Department of Education 

Mary De Carlo, Director, Curriculum Laboratory, Catholic University 

Randy and Bonny Graham, Directors » Living School Project, University of Connecticut 

Joseph Griggs, School Mental Health Consultant, National Institute of Mental Health 

Eric Haughton, Faculty of Education, York University, Ontario, Canada 

Jean Hebeler, Head, Department of Special Education, University of Maryland 

Richard Hennlng, Supervisor of Special Education, D. C. Public Schools 

Nicholas Long, Professor of Education, American University 

Bill Mitchell, Coordinator, Teacher Education Center, University of Maryland and 

Montgomery County Public Schools 
Robert Proudy, Professor of Education, George Washington University 
Nancy Roche, Coordinator, Teacher Education Center, American University and 

Montgomery County Public Schools 
Marshall Rosenberg, Community Psychological Consultants, St. Louis, Missouri 
Charles Seashore, National Training Labs 
Henry Smith, U. S. Office of Education 



COMPETENCY PLANNING (LEVEL 4) 

Why la Beman, SB 
George Brown, MI 
Jacqueline Bylsma, MT 
Ellen Congleton, SB 
Maxine Counihan, SB 
John Gannon, MT 
Roger Gessay, MT 
Roslyn Inman, MT 
Steve Johnsen, MT 
Rita Mann,, SB 
Carol Neill» SB 
John Schneider, MT 
Pat Wright, SB 

COMPETENCY AREA COORDINATORS (LEVEL 5) 
Mark Twain Staff 

Stan Fagen, Supervisor, Staff 

Development 
Jeff Hill, Science Teacher 
Roz Inman, Staff Development 

S^pecialist 
Phyllis McDonald, Coordinator, IRC 
Judy Tarr, Diagnostic/Prescriptive 

Teacher 



School-Based Staff 

Maxine Counihan, Program Specialist' 
Richard Henning, Supervisor of Special 

Education, D.C.P.S. 
Gevaldine Meltz, Supervisor, Mark Twain 

School-Based Programs 
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PROGRAM DIRECTION (LEVEL 6) 

Stanley Fagen, Supervisor of Professional Development 
EVALUATION STAFF 

Stephen Checkon, Supervisor of Evaluation and Research 
Lois Proctor, Evaluation and Research Specialist 
Sandra Brealauer, Research Assistant 

PROGRAM DISSEMINATION 

Elaine Lessenco, Comminications Assistant 
SECRETARIAL STAFF 



Dinah Benson, Evaluation and Research 
Eunice Jacquot, School-Based Prograus 
Lisa Ritzenberg, Staff Development 
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Statements of Competencies, Subcompetencles, and Performance 
and Behavioral Objectives 

COMPETENCY 1. PSYCHOEDUCATIONAL ASSESSMENT AND PROGRAMMING 

Subcompetency 1*1* Ability to complete a psychoeducatlonal profile. Including 

learner strengths and weaknesses, style|,r-4uul Interpersonal 
fimctlons* I 

?*0. 1,1*1, Ability to interpret and integrate a variety of assessment 
Instruments and techniques In the affective domain* 

B*0* l*l«l>(a) Given a student's cumulative record, the intern will be 

able to recognize and extract data relevant to the pupil *8 
self-concept. Interests, human relations, and problem- 
solving style* 

B*0* 1*1,1* (b) After participating In Marshall Rosenberg's Workshop on 
mutual education, the intern will be able to translate 

pupil's statements into appropriate "you feel " 

and "you want " statements* 

B*0* 1*1,1, (c) The intern will administer an Interest survey or engage 
the pupil in an informal discussion of his (the pupil's) 
interests, likes, dislikes, etc. Any subsequent pro- 
gramming for the pupil will include some recognition of 
the pupil's interests, likes, dislikes, etc* 

P*0* 1*1*2, Ability to interpret, administer, and integrate a variety of 

assessment lilstruments and techniques in the perceptual domain, 

B*0* 1*1*2* (a) Given a pupil's cumulative record, the intern will 
recognize and select data relating to the pupil's 
perceptual development* 

B*0* 1*1*2* (b) Given the pupil's test booklets, examiner's manual, and 
test cards, the intern wil^l be able to administer aLd \_ 
interpret the data from th^ Slingerland (Malcomesius) 
Specific Language Disabilities Test* 

B*0* 1*1*2* (c) The Intern will be able to administer and interpret 

informal assessment techniques of visual discrimination * 

fa*0* 1,1*2* (d) The Intern will hk able to administer and interpret 
Infor^l assessment techniques of visual to motor 
performance * ^ 

B*0, 1*1*2* (e) The Interns will be able to adminii^ter 1 or more Informal 
assessment techniques of visual memory * 
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B.0> l>l>2*(f) The intern will be able to administer and interpret 

informal assessment techniques of auditory discrimination ^ 



B>0> 1.1.2. jg) The intern will be able to administer and interpret 
informal assessment techniques of auditory to motor 
. memory * 

B.O. 1.1. 2. ih) After (while) viewing the film Why Billy >an't Learn , 
^ the intern will (1) list several of Billy's behaviors 
wKich{)are indicative of possible specific learning 
^ disabilities and (2) list all of the teaching and pro- 

gramming techniques ^own in the film* 

P,0> 1>1>3, Ability to interpret and iategrate a variety of assessment 
Instruments and techniques in the cognitive domain. 



B>0, l>l>3>(a) Given a pupil's cumulative record, the intern will 
recognize and select data relating to the pupil's 
cognitive development, 

B.O. 1.1.3. (b) After viewing the films Classif icatioa and Conservation 

(based on Piaget's theories), the intern will (1) develop 
an acceptable definition of the processes of classifica- 
tion and conservation and (2) distinguish and} list the 
characteristics of the preoperational, concrete opera- 
tional, and formal (abstract) operational levels of 
cognition* / 



Given a set of Attribute Materials, the intern will be 
able to (1) use* them with pupils to assess the pupil's 
level of cognition (pre, concrete, or formal operational) ^ 
and (2) use them with students in the school setting to 
develop cognitive skills. 

The intern will be able to classify typical curticulum 
questions, statements, and assignments according to 
Bloom's Taxonomy of Educational Objectives with 80 per 
cent accuracy. 

P.O. 1.1.4. Ability to interpret, administer, and integrate a variety of 

assessment instruments and techniques in the educational domain. 

B.O. 1.1^4. (a) After attending the Instructor's lecture and reading 

"I.Q. Abuse" (and other related articles from Psychology 
Today ) , Different Views of Intelligence by Alan Polittle, 
and ''Influence of Psychological Reports on Teacher 
Behavior and Pupil Performance" by W. Vixtor Beez, the 
intern will show a gross sense of the historical roots 
and structure of the Stanford Binet and WISC Intelligence 
Tests by being able to state: 



B.O. 1.1.3. (c) 
■ B.O. 1.1.3. (d) 
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1, The reason Simon & Blnet were commissioned to devise 
a test, 

2. The composition of the population in terms of color 

\ 



and nationality of the Stanford Blnet, 



3. That the Stanford Blnet is based on a mental age 
concept and define mental age concept, 

4. That the WISC is based on subtest performance, and 

5. The racial composition of the /nSC standardization 
sample. 

B,0, 1,1*4, (b) .Given the WISC subtest scores for kstudent, the intern 
will form several provisional hypotlifewas about that 
student's intelligence* 

B,0, 1,1*4. (c) The intern will be able to write the formula for intelli- 
gence quotient computation* 

B,0, 1*1,4* (d) The intern mV differentiate between process/product 
or fluid/cryst*.-..li2ed intelligence demands. 

B,0. 1.1,4, (eX The intern will be able to state in terms of process/^ 

product the intellectual demand made by the WISC subtests 
on: information, vocabulary, arithmetic, similarities, 
comprehension, and block design* 

B.O. 1*1.4. (f ) Given certain subtest patterns, the intern will be able 
to inf er : 

1. Possible cultural exposure 

2. Potential learning activity 

3. Ability to make use of opportunity he is exposed to: 

* a) In world v 

b) In school 

4. ''Ability to acquire new material 

Impairment in functioning through anxiety 

B.O. 1. 1*4. (g) Given t! ten subtests, the intern will be able, in one 
sentenct^, to describe the task of at least six. 

B.O. 1. 1*4* (h) Given the ten subtests, the intern will be able, in one 
sentence, to describe the cognitive demand of at least 
six. 
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B>0, 1,1>4, (i) Given a subtest score pattern, the intern will be able 
to identify high scores in similarities, comprehension, 
and block design as possible counter Indicators of law * 
•I.Q- 

B*Q, ltl.4* (j) The intern will bfe able to state which subtest is most 
likely a reflection of the extent of exposure to the 
American cultur^^ 

B^O, 1,1.4. (k) The Intern will be able to state at least one subtest 
which could reflect the amount of advantage a person 
has taken of his opportunities* 

t> 

B,Q. 1*1*4,(1) The intern will be able to state the two subtests which 
suggest the individual's ability to acquire new 
information, 

B,Q* 1*1.4* (m) The intern will be able to state the mean, range, and 
standard deviation ot the WISC subtest scores. 

P.O. 1.1*5. Ability to assess the student's learning style. \ 

B,0. 1.1.5. (a) After studying the book Diagnostic Teac ing by Marshall 
Rosenberg, the intern will be able to classify a list of 
pupil behaviors as either Rigid- Inhihl fed Style, 
Undisciplined Style, Acceptance-Anxious Style, or 
Creative Style with 80 per cent or better accuracy. 

B,0. 1.1.5. (b) After studying the book Diagnostic Teaching , the intern 
will be able to classify a list of program adjustments 
for pupils as being iftost appropriate to either the 
Rigid-Inhibited Style, the Undisciplined Style, the 
Anxious-Acceptance Style, or the Creative Style. 

B.Q. 1.1,5. (c) After seeing the film Why Billy Can't Lear n, reading the 
pamphlet titled "Learning Disabilities due to Minimal 
Brain Dysfunction,'* and rp;»Hing the arcicle ''Learning 
to Learn: New Techniques Help Pupils Who Can't Grasp 
j Fundamental Concepts," the intern will be able to list 

20 or more behaviors and/or signs of pupils with specific 
learning disabilities. 

B,0. 1.1.5*(d) Given a pupil's cumulative record, the intern will be 
able to identify and extract data indicative of the 
pupil's learning style and any successful program 
• * adjustments made for that pupil. 

Subcompetency 1.2. Ability to use assessment information for planning an 

individual program and for evaluation of progress. 

/ 
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?.0. 1,2,1, Ability to develop a series of aj^propriate instructional aod 
> behavioral objectives for a given student after completing a 
psychoeducational assessment. (Iijistruction in Competency 3.) 

Ability to demonstrate use of the student's primary learning 
style in program planning. (Instruction in Competency 3.) 

Ability to develop and Implement at least two dif.£er:ent 
strategies by which to achieve each stated instructional and 
behavioral objective. 

B.O. 1.2.3. (a) After demonstration and instruction, the intern will be 
able to demonstrate and/or use with Specific Learning 
Disabilities pupils the following techniques or programs: 

J.. A Guide to Teaching Phonics by June Lyday Orton 

(Educator's Publishing Service, Inc.) in conjunction 
with the Merrill and Lippincott Linquistic Readers 

2. "The Neurological Impress Remedial Reading Technique", 
by R. G. Heckelman ( Acadmic Therapy Quarterly ) 

3. Structural Mathematics by Stern, Stern, & Gould 
(Merrill) 

4. VAKT and/or Fernauld spelling 

5. Rhythmic spelling 

6. Audex-Motility Training & Phonics Program (Educational 
Dev^op(pent Laboratories) 

7. Michigan Tracking Program '(Ann Arbor Publishers) 

8. Three or more strategies for correcting poor 
physical coordination 

B.O. 1.2.3. (b) 



B.O. 1.2.3. (c) 



P,0, 1.2.2. 
P.O. 1.2.3. 



After seeing the ^Im Why Billy Can't Learn , reading 
the pamphlet "Leaning Disabilities due to Minimal 
Brain Dysfunction," and reading the article "Learning 
to Learn: .New Techniques Help Pupils Who Can't Grasp 
Fundamental Concepts," the intern will be able to list 
13 or more techniques and/or program adjustments 
appropriate for pupil^^ith specific learning disabilities 

The intern will become familiar with techniques and 
program adjustments used by Mark Twain school based 
student resource teachers^. < 
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c 

B,0, 1,2,3, (d) After studying the book Diag|[K)stlc Teaching by Marshall 
Rosenberg, the intern will be>able tg classify a list 
' , oft program adjustment.' for pupils as being most appro- ^ 

priate to the Rigid- Inhibited Style, thfe Undisciplined 
Style, the -Anxious-Acceptance Style, or the Creative 
\ , Style* ' t . , 

B,C, 1,2, 3, (e) The intem will provide evidence of having utilized the 
* , • Diagnostic Teaph^ng- programming concepts during theii: 

Hark IVain ')>racticum experiences. 

B,0, 112,3, (f (A) Given "a ^et of data (diagnostic report) from a 
y ^uplj.'s educ^lonal and perceptual testing, the 

^.n€^rti .will recoociend an appro|priate reading program 
or method ani substantiate thlT recommendation with 
six or more pieces of data from the report . . ' 

(B) The intem will make six or more specific- program' 
^teaching techniques) recommendations and substantiate 
' ; the need for each with data fro|B the report. 

P,0, 1,2,4, Ability to establish and use evaluation criterion with student^. 

and teachers several tikes' during the schpo^^ye^r, (Instruc'-" 
^ tion in Competency 3,) ' ' 

COMPETENCY 2, HUMAN RELATIONS AND .doUlf SELING • . • ' * 

" " :> . • ' - - 

Subcompetency 2,1, Ability to cq^rehend and communicate effectively in an 

educational setting, ^ . ' , " ,.>^*\ 




P,0, .2,1.1, Demonstr*at^ ability tor^o^reh^d and clarilry individual 
' communications j>oth in t,^ no of. content and -feeling with 
students ahd" peers, , . • 

' * ' . , ' - \ 

B,0, 2,1,1, (a) LeanAer will accurately discriminate betxeen the content 
.and feB^iixg of written communications, /(Illustrative 
student statements & COFI,) ^ 

B,0, 2,1,1»(4^ Learner will acpu^l^ely discriminate between the content 
and feelings of verhaL communications in sH individual ^ 
couil9€ 1 in^^itifiila ti on , 

F,0. 2,1,2, Danonstrates ability to comprehend and clarify/group communica- 
tions bo;:h in terms .of cq;[ite&t and feeling witli students and 
peers.^ , . (^;. 

B,0. 2,1,2, (a) Learner will accurately discriminate between the content 
and"^'feeiii\g" of verbal communications in a group discus- 
sion simulation^ 

Subcompetenc y 2,2, Ability td interact witn empathy, respect, specificity, 

self-awar&eiiS , and self-aLreptance in an educational 
setting. ^ 

V 
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P.O. Demonstrates knowledge Of the concept and expression of the 

above characteristics in counseling and human relations'. 

B..0. 2.2.1. (a) Learner- will define the concept and expression of empathy 
through appropriate categorizing of levels of esipathic 
expression. 

B.O. 2.2.1. (b) Learner will define the concept and expression of respect 
through appropriate categorizing of levels of respectful 
expression. 

p.p. 2.2.1. (c) Learner will define the concept and expression of speci- 
ficity through appropriate categorising of levels of 
specific expression. 



B.Q. 2j^l.(d) Learner will define the concept and expression of self- 
awareness through identification of levels of self- 



awareness expression. 



B.O. 2.2.1. (e) Learner will define the concept and expression of self- 
acceptance through identification of levels of self- 
acceptance. 

P,0, ^2.2. ' Demonstrates ability to effectively use each of the above 
characteristics for a helping relationship. 

V B'.O. 2.2.2. (a) Learner will demonstrate facilitating levels of empathy 

for a helping relationship by display of at least Level 3 
% responses on the empathy scale in an individual counseling 

simulation. 

^B.Tf.> 2.2.2. (b) Learner will demonstrate facilitating levels of respect 
- for a helping relationship by display of at least Level 3 

' ^ *' responses on the respect scale in an individual counseling 

simulation. 

^ B.O. 2.2.2. (c) Learner will demonstrate facilitating levels of specificity 
^ ^^ for a helping relationship by display of at least Level 3 

responses on the specificity scale in an individual 

counseling simulation. 

B.O. 2.2.2. (d) To be developed. 

B.O. 2.2.2. (e) To be developed. 

Sub competency ^.3. Ability to facilitate attainment of humanistic educational 

objectives in groups. 

P.O. 2.3.1. Demonstrates ability to formulate humanistic (affective) educa- 
tional objectives for groups of students and staff. 
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B>Q> 2. 3.1, (a) Learner will scate expiiuit affective objectives related 
to skill, interpersonal, and system levels of transaction 
in an educational setting. ,i 

B,0, 2.3.1. (b) Learner will identify illustrative behavior criteria for 
evaluating progress towards explicitly stated affective 
objectives. 

P.O, 2.3.2. Demonstrates ability to select and develop strategies for 
achieving affective objectives in groups, 

B.O. 2,3,2, (a) Learner will identify at least two specific techniques 
for promoting affective objectives at the skill, inter- 
personal, and system level of transaction. 

B.C. 2.3.2. (b) Learner will develop at least one original .technique 

for promoting affective obj ectives ^ t:*l'e skill, inter- 
personal, and system ^vgyj^^l-trfTrausaction. 

P.O. 2.3.3, Demonstrates knowledge of and ability to perform a variety of 

leader functions appropriate to the objectives for and needs of 
the group. 

B.O, 2,3.3. (a) Learner will select and describe a set of leader functions 
designed to promote attainment of specific, objectives in 
a group situation. 

B.O, 2,3.3.(b) Learner will demonstrate, in a real or simulation group 
situation, the use of a variety of leader functions to 
promote attainment of specific objectives. 

B.O, 2.3.3. (c) Learner will describe, orally or in writing, a logical 
process for identifying and resolving discrepancies 
between Self as leader and group. 

COMPETENCY 3. CURRICULUM DEVELOPMENT AND IMPLEMENTATION 

Subcompetency 3.1. Ability to plan and organize an instructional system appro- 
priate Co the cognitive and affective needs of students, 

P.O. 3.1,1, Demonstrates the ability to plan and sequence an instructiOFial 
program. 

P,0, 3.1.2. Demonstrates the ability to formulate behavioral and performaace 
objectives appropriate to the cognitive and affective needs ot* 
students . 

< P.O. 3.1.3. Demonstrates the ability to plan for the evaluation of student 
progress on specified behavioral and perfoniance objectives. 
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Subcompetency 3,2, Ability to develop and select curriculum appropriate to the 

cognitive and affective needs of students. 

P,0, 3.2.1. Demonstrates knowledge of concepts and strategies presented 
through prepackaged curricula. 

P,0. 3.2.2. Demonstrates ability to design curriculum to meet specific 

learner needs by abstracting and integrating elements of knovm 
curriculum. 

P.O. 3.2.3. Demonstrates the ability to generate additional curriculum 
content from an established conceptual base. 

Subcompetency 3.3. Ability to plan and Implement a variety of learning activi- 
ties and teaching strategies related to appropriate perform- 
ance objectives and curriculum content. 

P.O. 3.3.1. Demonstrates the ability to plan a variety of learning activi- 
ties and teaching strategies related to appropriate performance 
objectives and curriculum content. 

P.O. 3.3.2. Demonstrates the ability to implement a variety of learning 
activities and teaching strategies related to appropriate 
performance objectives and curriculum content. 

Subcompetency 3.4. Ability to select appropriate instructional materials from 

available ifte^ources and develop instructional materials 
necessary to individualize instruction. 

P«0. 3.4.1. Demonstrates the ability to use the resources for instructional 
materials in MCPS and surrounding areas effectively. 

P.O. 3.4.2. Demonstrates the ability to design and produce multimedia 
instructional materials. 

P.O. 3.4.3. Demonstrates the ability to operate A-V equipment necessary for 
the instructional program. 

P.O. 3.4.4. Demonstrates the ability to match media with student style, 
needs, and requirements. 

P.O. 3.4.5. Demonstrates the ability to evaluate worth of commercial 
materials and modify to fit needs of special students. 

COMPETENCY 4. BEHAVIOR MANAGEMENT 

Subcompetency 4.1. Ability to establish and reinforce behavioral values, 

expectations, and limits in an educational setting. 

P.O. 4.1.1. Demonstrates knowledge of relevant criteria for identification 
of "emotionally disturbed" youth. 
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B,0, 4,1,1, (a) Learner will accurately identify, in writing, at lease 
four criteria for making a decision regarding selection 
of a student into an educational program for "emotionally 
disturbed" yputh and will clearly relate these criteria 
to specific background information provided in a 
standardized case study of a problem adolescent. 

F,0, 4,1,2. Demonstrates thoughtful consideration of basic limits or 

standards for all persons in a learning environment (children 
and staff), including rationale (the value-base for the limit) 
and likely consequences of adherence to such limits within and 
outside the school. 



B,0. 4,1,2, (a) Learner will list specific behaviors which he considers 
unacceptable in an educational setting. 

B,Q, 4,1.2. (b) Learner will identify and discuss a rationale for each 
specific behavior listed and the likely consequences of 
adhering to that limit within and outside the school, 

B,0, 4,1.2. (c) Learner will compare his own statement of limits, rationale, 
and likely consequences to a referent set of statements 
gathered from peers and instructors and reevaluate this 
statement indicating changes, if any, 

P,0, 4.1.3, Demonstrates knowledge and ability to design and manage a 
learning environment so as to enhance and reinforce one's 
behavior-values , 

B,0, 4, 1,3, (a) Learner will accurately apply knowledge of at least two 
of three major educational strategies (j^,e . , sensory- 
neurological, psychodynamic-interpersonal , behavior 
modification) by analyzing a standardized case study of 
a problem adolescent with regard to the following 
dimensions: (1) causation, (2) diagnostic or assessment 
information, (3) goals or objectives, and (4) illustrative 
method (s ) to achieve goal (s) , 

B,Q, 4,1,3, (b) Learner will accurately identify, orally or in writing, 

at least four of six design and management strategies for 
enhancing behavior-values, as practiced by self or others 

» modelling, structurinig physical environment, 
reinforcement, planned ignoring, regulated permission, 
stating and enforcing consequences.) 

B,0, 4,1,3. (c) Learner will demonstrate, through a video tape, audio 
tape, or scheduled observation, successful application 
of at least four of six design and management strategies 
for enhancing behavior-values. 
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Subcompetency 4,2, Ability to identify and teach strategies for coping with 

conflict and frustration in an educational setting. 

P.O. 4,2,1, Demonstrates knowledge of major areas of adolescent conflict 
'~ ( i ,e . , sex, aggression, and dependency) within individual, 

group, and school environment and the learning sources related 
to these conflicts. 



B.O. 4.2.1, (a) Learner will meaningfully discuv«;s typical conflicts of 
adolescence and the learning sources of these conflicts 
in at least one of three bas^c human need areas ^( i*e . , 
dependency- inclusion, sexuality-affection, and aggression- 
control. ) 

B.O. 4.2.1. (b) Learner will present, orally or in writing, an analysis 
of relevant conflicts and the learning sources of these 
conflicts as applied to a personal study of at least one 
adolescent. (Note: to be initiated during 1973-1974 
Internship Program.) 

P.O. 4.2.'2. Demonstrates ability to identify and employ alternatives for 
helping an individual manage or resolve conflicts and 
frustrations. 



B.O. 4.2.2. (a) Learner will develop an original lesson illustrating at 
least one strategy for coping with frustration. 

B.O. 4.2.2. (b) Learner will demonstrate effective teaching implementation 
of at least one technique from each of two major strategies 
for coping with frustration, either in a group lesson or 
a life-space interview by presenting a video tape, audio 
tape, or scheduled observation. 

B.O. 4.2.2. (c) Learner will be able to induce a moderate frustration 
experience in classroom and conduct a meaningful 
''acceptance** discussion. 

Subcompetency 4.3. Ability to develop and use teacher-intervention techniques 

to effectively manage disruptive school behavior. 

P.O. 4.3.1. Demonstrates knowledge of surface management, life-space inter- 
viewing, and operant principles and procedures. 

B.O. 4.3.1. (a) Learner will accurately provide a written description of 
self or others app.\ying^ at least 9 of 12 surface manage- 
ment techniques . • 

B.O. 4. 3.1. (b) Learner will respond, in writing, to a standardized case 
description by indicating an appropriate strategy for 
conducting a life-space interview or learner will write 
up one's own application of a life-space interview 
strategy to a real practicum situation. 
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P,0, U.3.2. Demonstrates skill in use of surface management, life-space 
interviewing, and operant principles and procedures. 

B.O. 4.3.2. (a) Learner will effectively demonstrate in a standardized 

simulation situation at least 9 of 12 surface management 
techniques . 

f 

B.O. 4.3.2. (b) Learner will demonstrate in a standardized simulation i 
situation an effective application of a life-space 
interviewl 

B.O. 4.3.2. (c) Learner will design, implement, and write-up an operant 
program applied to a specific individual or group. 

COMPETENCY 5. SYSTEMS ANALYSIS AND CONSULTATION 

Subcompetency 5.1. Ability to formulate and communicate concepts of family, 

community, and educational systems and their effects on 
student behavior and adjustment. 

P.O. 5.1.1. Demonstrate ability to assess how family, community, and 

educational factors affect the functioning of a particular 
student in a particular school setting. 

B.O. 5.1.1. (a) Analyze the academic and behavioral situation of a student 
in order to design an educational program for this same 
character . 

P.O. 5.1.2. Demonstrates ability to translate knowledge of systems influ- 
ences into a plan for change which will enable a student In 
need of help to function more effectively, 

B.O. 5.1.2. (a) Given a particular situation which includes information 
on the family, home, and school systems, determine in 
which system or systems it is possible to create some 
significant change and your rationale for it. 

P.O. 5.1.3. Demonstrates ability to carry out a parent conference which 
increases lines of communication between home and school and 
develops a concrete follow-up plan. 

B.O. 5.1. 3. (a) Given the facts surrounding a situation which calls for 

a family conference, write up a plan which will take into 
consideration : 

1. Who should be present at the conference? 

2. What questions should be asked of the parents, the 
child, and other members present? 

3. What questions do you need to ask and answer for 
yourself? 

4. *What are the minimal expectations from participants 
which are required to move into a concrete plan? 
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Subcompetency 5.2. Ability to identify and use organizational processes and 

structures for connounication, decision-making, and conflict 
resolution* 

/ 

P.O. 5.2.1.* To demonstrate knowledge of the formal and informal power 
~' structure of a local school. 

B.O. 5.2,1. (a) Given a lecture and discussion, the learner will be able 
to list system values and normative behavior that existed 
in some organization of which they were a part. (School, 
business, political, or social organization.) 

B.O. 5.2.1.(b) Given a discussion aftex a role-playing situation which 
simulates a school conference, the learner will be able 
to recognize role expectations and role hindrances and 
be able to form some hypothesis about the influence role 
expectations have on planning for a student. 

P.O. 5.2.2. To identify reaction within the system to conflict situations 

between teachers* and stiident, student and student, and teacher 
and teacher. 

B.O. 5.2.2. (a) Given a conflict situation in a classroom, role-play 

consultative situation with a teacher around this conflict. 

(*Teacher is identified as adult in school setting.) 

P.O. 5.2.3. To identify and appreciate policies and formal and informal 
" practices which promote or hinder organizational objectives. 

B.O. 5.2.3. (a) Given a school in which you're doing an internship, write 
' a paper taking Into consideration the f|)rmal and informal 
power structure, official policies, andl informal organiza- 
tional practices that promote or hinder^organizational 
objectives. 

Subcompetency 5.3. Ability in a consultative process to help others identify 

and understand student> staff, and own behavior within a 
given system. 

P.O. 5.3.1. To be aware of and participate in several consultative situations 
that arise in a school setting, i.e . , team consultation, 
individual teacher consultation, and work group consultation. 

B.O. 5.3.1. (a) Gather pertinent data to use in the consultative process. 

P.O. 5.3.2. To be in touch with your own feelings and values, and those of 
the consultees. In a given consultative situation. 

B.O. 5.3.2. (a) Having observed ^ classroom, plan positive feedback 

information to be given to that teacher about her own 
behavior. 
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B,0, 5,3,2, (b) Given participation in a demonstration of a ^nsulting 
situation, the interns will be able to ai^Iyze their 
feelings and the feeling and values of the 
consultees. 

B,0, 5,3,2, (c) Given an opportunity to discuss past experiences in which 
problem-solving situations led to conflict, identify 
those feelings and values in yourself and the others which 
brought you intd conflict, 

P,0, 5,3,3, To develop and use consultative strategies that will suit 
situations and personal styles arising in school settings, 

B,0, 5, 3>3, (a) Given information on the steps of a consulting model, 
the students will demonstrate the model through role 
playing.. 
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APPENDIX E 

Form Used for Practlcum, Seminar, and Suanary Evaluation of Intern Coopetencies 

MARK TWAIN SCHOOL MARK TWAIN TEACHER INTERNSHIP PROGRAM 

1551 Avery Road 

Rockville» Maryland 20853 Intern Evaluation Form 

Intern ^ Date 



Superviaor(a) 

A primary objective of the Mark Twain Teacher Internship Program ia to promote effectiveness in both professional 
competenciea an4 peraonal characteristics judged to be criticsl for teaching youth with emotional and learning 
difficulties.' This form provides s aeana for aasessing intern performance in both of these categories. It is 
expected that thia evaluation format will serve as a focus for individual conferencing to promote continuing 
profeaaional development 



I. Profeaaional Competency . 

Conaitfer the above named intern in relation to what you think would be an acceptable level of skill for a teacher 
of adoleacenta wivh learning and emotional problems. Thus, for the purpose of this evaluation, Judging the intern 
aa **Eff active** in a competency would mean you believe this level of skill to be acceptable or adequate. Indicating 
**Highly Effective" would mean that you Judge the intern as having advanced well beyond an acceptable or adequate 
level. '*Need8 Strengthening" would mean; that you Judge the intern aa not yet having reached an acceptable or 
adequate level. 



Pleaae note that there are aeven points on each rating scale. However, in making your ratings, you may place an X 
at any point along the continuum from 1 to 7. If you feel unable to rate the intern in a particular subcompetency, 
circle tha **N** in the '*No Opinion** column. Please write coOBienta, if any, in the apacea provided. 



Competency 
Area 


Subcompetency Criteria 


Needs i i Highly No 
Strength i Effective * Effective Opinion 


. 0 u 

-H a 

M T} S 
^ 4) OS 


1.1. Able to complete a psychoeducational profile, 
including learner strengths and weaknesses, style, 
snd interpersonal functions-^ 

1.2. Able to use assessment inlomation for plan* 
ning an individual program ana for evaluation of 
pro&reas. 


1 2j345i6 7 N 
1 2134516 7 N 


Comnents: 


COMPETENCY 2 
Human Relations 
and 
Counseling 


2.1. Able to comprehend and conaunicate effectively 
in an educational setting. 

2.2. Able to inter|ict with empathy, respect, spec- 
ificity, self-awareness, and aelf-acceptance. 

2.3. Able to facilitate atteinment of humanistic 
educational obi actives in i^roups. 


1 2 ' 3 A 5 ' 6 7 N 
1 2 ' 3 A 5 ' 6 7 N 
1 2'345'6 7 N 


Comnents : 


u 
a 

o 0 5 
C g ^ 1 

o u W 

•H M 
U 

u 


3.1. Able to plan and organize an instructional 
system appropriate to the cognitive and affective 
needa of students. 

3.2. Abl'« to develop and select curriculum content 
appropriate to the cognitive and affective needs 
of the student. 

3.3. Able to plan and implement a variety of learn* 
ing activities and teaching strar.egies relsted to 
appropriate performance objectives and curriculum 
content • 

3. A. Able t*- select appropriate instructional 
materia om available resources and develop 
material. .eseary to individualize instruction. 


1 2,345|6 7 N 
1 2 I 3 4 5 , 6 7 N 

1 2 I 3 4 5 I 6 7 N 
1 2,345,6 7^ N 


ComsM>nta: < 

■ "/'!) 



Note: Completed by aeminar inatructor and each of three practicum aupervlsors. 

This form is s revision of the one used in 1972-73, but contains the same categories of information. 
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Coapecency 
Area 


— ^ 

Subcompecency Criteria] 


Nseis 
Strength 


* Effective 


« Highly 
1 Effective 


No 
Opinion 


44 

C 


4tl« Able to establish and reinforce behavioral 
valuea, expectations and limits in an • 
educational setting. 


1 2 


'345 


• 6 7 


N 


I 

-* & 

1! 


4.2. Able to identify and teach strategies for 
coping with conflict and frustration in an 
educational settings 


1 2 


'345 


• 6 7 


N 


%t 


4.3. Able to develop and use teacher inter** 
vention techniques to effectively aanage 
disruptive school behavior. 


1 2 


« 3 4 5 


• 6 7 


N 




Connenta : 





»A • G 

>s O 

U « 4J 

_ - a 

a u o 



is 



5.1. 

of fanily, co^BBunity* and educational systeas 
and their effects on student behavior and 
adjustment. 

5.2. Able to identify and use organizational 
proteases and atructures for con&unication, 
decisionvMklng, and conflict resolution. 

5.3. Able in a consultative process to help 
others identify and understand student, staff, 
and ovn behavior within a &iven system. 



1 2 



1 2 



»3 4 5 



.3 4 5 



6 7 



6 7 



1 2 3 4 5 6 7 



Cos 



II. Personal Characteristics . 
Consider hov typically the intern displays the following highly valued characteristics. For the purposa of this 
evaluation, "Ef fective'* means the intern often displays each of the attributes conrpriaing the personal 
characteristic. ^'Highly Effective" aeans he or she typically displays aach of the attributes for that characteristic. 
"Needs Strengthening*' would mean that the intern does not often display each of the attributes. 



Please note again that there are seven points on each rating scale. In laarlcing your ratings ycu nay place an 
X at any point along the continuum from 1 to 7. Circling *V* indicatea that you feel unable to rate the intern on 
that characteristic. Please write any comments in the spaces provided. 



f 

Characteristic 


Criteria Attributes 


Needs i - ( Highly No 
Strength (Effective (Effective Opinion 


Emotional 
Stability 


Aa evidenced by reality orientation, 
sense of humor, calmness and 
appropriateness of Involvement 
in crisis situations, perseverance 
under stress, optimism, ^satisfaction 
from own efforts, honesty with 
self and others, resilience, and 
flexibility. 


1 2 13 4 5 16 r N 


Comments : 


Interpersonal 
Relations 


As evidenced by respect for and interest 
in others, openness to ideas of others, 
ability to work in groups, empathy and 
warmth towards others, and appreciation of 
strengths in others. 


1 1 
1 2 »3 4 5 ' 6 7 N 


Comments : 


Initiative and 
Follow 
through 


As evidenced by courage to Initiate 
new ideas, thoroughness, ability to 
work independently, willingness to 
engage in problem solving, and wllling- 
neaa to try new alternatives. 


12 '3 45*6 7 N 


Conments : 
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Evaluation and Research: Intern Critique of Program Questionnaire and Results 



MARK TWAIN SCHOOL 
1551 Avery Road 
Rockville, Maryland 



Mark Twain Teacher Internship Program \ 

This questionnaire is designed to elicit your opinion of the Mark TWaln Internship instruc- 
tional prograat. Please be candid so the Information provided is useful for program improve 
meat. Your responses are anonymoxis and in no way can they affect Judgment of your perfor- 
mance aa a trainee. 

Please respond by indicating the number of the appropriate scale that corresponds to your 
answer for each competency area. 



A. Questions 1-12; !_ 



No/Never 



1. Were the seminar 

' objectives made clear? 

2. Did the announced 
objectives and what 
was actually taught 
agree? 

3. Was seminar time well 
used and not wasted? 

4. Were instructors well 
prepared for each 
seminar meeting? 

5. Were the learning 
activities and exper- 
iences too repetitive? 

6. Die' the instructors 
raise challenging 
questions or problems 
for discussion? 

7. Were Instructors gen- 
uinely concerned with 
your progress and 
actively helpful? 



As Often As /Not 



Yes/Always No Opinion 



I IJ/ 111 IV , V 

Psychoed. Coundeling Curric. Behavior Systems 
Assessment and/H. R. Develop . Manage . Analysis 



4.50 



4.63 



4.63 



4.75 



2.38 



3.38 



4.13 



4.13 



3.88 



3.75 



4.75 



2.75 



3.50 



4.50 



3.63 



3.50 / 



3.00 



3.73 



2.38 



3.50 



4.13 



4.25 



4.38 



4.00 



4,63 



2.38 



3.38 



4.25 



3.38 



3.71 



3.25 



3,71 



2.38 



3.38 



4.00 



Mean 



4.03 



3.92 



3.68 



4.33 



2.45 



3.45 



4.23 
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Questions 1-12 coat . 



Psychoed • 
Assessment 



8. Were major points or 
concepts summatlzed 

or emphasized?' 4.00 

9. Were you given suf- 
ficient opportunities 

to express your opinions? 3*88 

V 

10. Were Instructors avail- 
able for consultation 

outside of class?' 4.25 

11. Did evaluation activi- 
ties reflect the con- 
tent of the seminars? 3. 75 

12. Was your internet in 
the subject heightened 

by the seminars? 4.25 



B. Questions 13-17 ; 1^ 



13. 



14. 



15. 



16. 



II 

Counseling 
and H. R. 



4.13 



4.25 



4.25 



4.13 



4.25 



III 
Curric . 
Develop . 



3.13 



3.63 



4.38 



IV V 
Behavior Systeas 
Manage. Analysis 



3.69 



3.50 



Not Enough 

How do 'you feel about 
the scope of .the sem- 
inars and the amount 
of material covered? 4.13 

How much effort 

(work-load) did you 

have to put into the 

course? 3.29 

For your level of 

prior preparation, 

how would you rate 

the difficulty of the 

material covered? 3.00 

How would you rate the 

speed at which material 

was introduced and 7 

covered? 4.00 



About Right 



2.75 



3.14 



2.75 



2.63 



3.00 



3.43 



2.38 



2.88 



3.75 



4.00 



4.25 



4.25 



4.-13 



3.29 



3.88 



4.00 



3.75 



4.00 



Mean 
3.63 . 
3.88 . 

t 

4.3 > 
3.90 



* 3.93 

( 



Too Much Mo Opii^lpn 



2.75 



2.71 



2.71 2.57 



2.38 2.57 



2.50 



2.43 



3.13 



3.20 



2.58 



2.98 
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questions 13-17 cont > 

17* What is your opinion 
of the emphasis 
placed on: 

a) Theoretical 
cons ide rat ions ? 

b) Practical aspect's? 



I II III 

Psychoed . Counseling Curr ic , 
Assessment and R, I>evel# 



3.57 
2.71 



2.75 
3.00 



3.13 
2.75 



IV V V 

Behavior Systems^ 
HanaRe . Analysis 



2.88 
2.75 



2.86 
2.75 



Mean 



,3.09 
2.79 



C. Questions 18-21 ; 1 



Poor 



18. Compared to o 'her 

instructors you have 
had (in hipii school 



Good 



Excellent No Opinion 



would you rate the 
teaching skill of 
seminar Instructors? 


3.63 


3.81 


3.00 


3.38 


2.75 


3.36 


In general, how would 
you rate the: 

a) Lectures ? 


3.38 


3.50 


2.50 


3.13 


2.75 


3.00 


b) Class discussions? 


2.75 


3.50 


2.75 


3.00 


2.88 


2.95 


c) Workshops and special 
learning activities? 


3.33 


3.12 


3.29 


3.12 


3.17 


3.23 


d) Reading materials? 


3.50 


3.50 


2.88 


3.38 


3.00 


3.23 


e) Films and other 
special learning 
materials? 


3.50 


3.12 


3.50 


3.14 


3.00 


A. 35 


f) Guest lecturers? 


3.00 


3.00 


3.00 


3.00 


3.13 


3.00* 


g) Evaluation activities? 


2.63 


3.88 


3.00 


2.88 


3.13 


3.08 


h) Quality and usefulness 
of feedback? 


3.25 


3.75 


3.14 


3.25 


3.43 


3.31 


How would you rate the 
usefulness for role per- 
formance of the resources 
aiid skills taught? 


3.50 


3.88 


3.25 


3.63 


3.50 


3.50 
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Questions 18-21 cbntJ* 
. f 
21. Oisrerall, how wp;^ld 
you rate the! ^ ^ 

aD» Valufe of 4|r^e 
seminars?/^ 



I • II "^III IV V 

Psychoed. Counseling ^ Currlc. Behavior Systems 
Asseaamentj and H. R. "Develop . Manage . Analysis 



4 



r 



. . 3^50 



b) Ef fectivepess -^-^ j I 
'^the instf^cti9n?C» 3.63 



/ 



3.88 
,4.00' 



3.13 



3.00 



3.38 



3.00 



3.63 • 3.00 



Mean* 



3.40 
3.45 



D. Li«t the thre'e most effective, learning experiences: 



\ 



Imes Mentioned # 



2. Sucvey of school -feystem k ^ 






\ 

3 


3. Counseling ^ctivitie^ 


i . 




'3 . 


List the three least ef^ctive leaimitig ex^erienc 
1. Bruce Joyce CoKnit±^^4}e^eJ^^Trt Strategies' 


% . 
.es 




. 7 


2. Issues in contea^^orary special edqcafcion 


c 








7-^ 






f r^r— 

t 

Additional Comments: ^ 

a: 




) • 

» V - 


If 



75 



ERIC 



k* APPENDIX G 

Ma^ Twain School Staff Critique of the 1971-72 Staff Development 
Institute with Mean Ratings by Team Teachers and Other Teachers 



i , ' MARK TWAIN SCHOOL 

? 1551 Avery .Road 

Rockvllle, Maryland 

Mark TVAn Staff Development Program: Evaluation and Research 
Institute Follow-up 

This questionnaire is designed to elicit your opinion of the initial Mark Twain 
Staff Development Institute now that you have experience on the Job. Your 
responses will be used to guide program planning and revision. Please be as 
specific as possible in your comments. , 

I. Goals ; The institute progr^ was developed to foster participant attainment 
of five goals thought to be basic for^working with children experiencing dif- 
ficulties with human relationships, self-organization, or other behaviorally- 
linked learning problems. 



A. How relevant have you found the basic program objectives to be f6r trains 
ing for your present assignm<pnt? 





Mean 


Rating on 


a 5~point Scale 






Team 


Other 




Teachers 


Teachers 


Goals 


Subgoals 


iN»20) 


(N-16) 


To develop skill in: 


Gain in the ability to: 






1^ Pupil Assessment 


. Complete a diagnostic profile 


4.1 


2.4 


and Programming 


. Interpret diagnostic findings 






. Use findings for programming 






2. Ircerpersona] 


. Comprehend ami communicate 






Relations 


effectively 








> Interact with ge lulneness, 








respect, and empathy 


4.4 


4.4 




. Provide constructive 








supervision 








• Promote mutual understanding 








and res6lution of problems 
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Mean 


Rating on 


a 5 point Scale 








Team 


Other 






Teachers 


leacners 




Goals 


oUDgOajLS 






To develop skill in: 


Gain in the ability to: 






3. 


Curriculum 


• Identify and develop educa- 








Implementat ion 


tional materials and tasks 










. Develop Individual perform- 










ance objectives 










• Employ teaching strategies 




3.8 






to meet needs of leaitier 










• Employ variety of educational 










techniques Materials 








Behavior 


• Establish realistic behavioral 








Management 


standards. 










. Identify sources of conflict 


4.5 


3.8 






. Develop and use teacher- 










intervention techniques 






5. 


Or ganizat ional 


• 

• Formulate and communicate 








Practices 


^ concj^pts of system influence 










on student behavior 










• Idmtify and use organiza- 


3.7 


J. J 






tional processes 










. Identify policies which pro- 










mote organizational objectives 







Average 



4.1 



B. How adequately do^ you feel you were prep^ired 
for your present assignment as a result of the 
experiences you received during the institute? 2, 



3.5 



3.3 



1. In which of the five goal areas do you 
feel competent? 

Pupil Assessment 47% 

Interpersonal Relations 79% 

Curriculum Implementation 63% 

Behavior Management 79% 

Organizational Practices 63% 

2. In which of the five goal areas do you 
feel in need of additional training? 

Pupil Assessment 32% 

Interpersonal Relations 11% 

Curriculum Implementation 32% 

Behavior Management 16% 

Organizational Practices 26% 



56% 
81% 



81% 

50% 



6% 
0% 
0/ 
19% 
31% 
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Mean Rating on a 5-polnt Scale 
Team Other 
Teachers Teachers ' 
(N«20) (N»16) 



1. 


The seminars? 


3.1 


2. 


Workshops and special learning activities? 


3.3 


3. 


The reading materials? 


2.9 


4. 


The effectiveness of Instruction? 


2.9 


5. 


The qijality and usefulness of feedback? 


2.7 


6. 


The Interest and helpfulness of 
iftstrucLors? 


3.6 



3^7 
1.8 



C* How suitable was the emphasis placed on: 

1. Theoretical considerations? 3.8 

2. Practical aspects? 1.6 
II. Instruction 

A. Did program Instruction and activities 
focus on major concepts and skills needed 

for your work? 2.5 

B. Wete you given sufficient opportunity to: 

1. Express your own Ideas? 4.4 
^ 2. Develop your own style? 4.0 

C. In general (and In light of your experience) 
how would you rate: " ~ 



2.9 

4:3 
3.8 



3.2 
3.5 
A- 3 
3.1 
2.9 
4.1 



III, Role-Performance 

A. Please list the learning activities or experiences that you have found 
especially useful, noting why. 



B, Please list the learning activities or experiences that you have found 
least useful, noting why. 



IV. Priorities for Future Mark Twala School Professional Development Ifrograms 

Please indicate what you consider to be major training priorities for the 
professional development of personnel entering the Mark 'iVain Internship 
Program. 
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APPENDIX H 
Resumes of Level 5 and 6 Personnel 

1. Stanley Fagen 
Title : 

Supervisor of Professional Development > Mark Twain School 

Major Project Responsibilities ; 

Project Director; Competency Coordinator tor Human Relations aAd 
Counseling and Behavior Management Areas 

Relevant Experience : 

Project Director, Mark Twain Staff Development Institute; Director of 
Evaluation and School Psychologist, Hillcrest Children's Center-American 
University Teacher Training Project; Clinical Child Psychologist, 
Hillcrest Children's Center, Washington, D. C, Family Service Agency of 
Prince George's County, Marlowe Heights, Maryland, and Walter Reed 
Medical Center, Washington, D. C. ; Director of Psychology Training, 
Hillcrest Children's Center and Children's Hospital of D* C, 

Professional Preparation : 

*1963 University of Pennsylvania, Philadelphia, Pennsylvania Ph.D. 
1959 University of Pennsylvania, Philadelphia, Pennsylvania M.A. 
1957 Brooklyn College, Brooklyn, New York B.A. 

2. Gerald ine Meltz 
Title : 

Supervisor of Mark Twain School-Based Programs, Montgomery County Public 
Schools 

Major Project Responsibilities : 

Associate Project Director; Competency Coordinator for Systems Analysis 
and Consultation Area 

R elevant Experience : 

Supervisor of Mark Twain School- Based Programs, MCPS; Principal, 
Washington Grove Elementary School, MCPS; Chairman, Program and Facilities 
Committee, Mark Twain School, MCPS; Assistant Principal, Lone Oak 
Elementary School, MCPS; Elementary School Teacher and Resource Teacher, 
MCPS; Director, Teenage Program, Montgomery County Jewish Community; 
Junior High English Teacher. D. C. Public Schools, Washington, D. 
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2. 



Geraldine Meltz cont. 



Professional Preparation ; 



1962 George Washington University, Washington, D. C. 
1941 Wilson Teachers College, Washington, D. C. 



M.S. 



3. Stephen Checkon 
Title ; 

Supervisor of Evaluation and Research, Mark Twain School 
Major Project- Responsibilities ; 

Director of Evaluation 
Relevant Experience ; ^ 

Supervisor, Evaluation and Research, Mark Twain School; Project 
Evaluator, Mark Twain Staff Development Institute; Assistant Director 
for Development and Teacher Specialist for Development, Department of 
Pupil and Program Appraisal, MCPS; Classroom and Resource Teachers, MCPS 

Professional Preparation : 

1973 The American University, Washington, D, C. Ph.D. 
1963 Indiana State College, Indiana, Pennsylvania M.Ed. 
I960 Indiana State College, Indiana, Pennsylvania B.A. 

4. Maxine Counihan 
Title : 

Program Specialist, Mark Twain Lchool-Based Programs, MCPS 
Ma)or Project Responsibilities ; 

Competency Coordinator for Psychceducational Assessment and Programming 
Area; Practice Teaching Supervisor, School-Based Program Placements 

Relevant Experience ; 

Program Specialist, Mark Twain School-Based Programs, MCPS; U. S. Office 
of Education Fellow, Bureau of Education for the Handicapped, Office of 
the Associate Coamlss loner. Program Planning and Coordination Staff; 
Education Program Consultant, Dorothea Dix Hospital, Raleigh, North 
Carolina; leacher, Durham Child Guidance Clinic, Durham, Itorth Carolina; 
Head Toacher, Adolescent Unit, John Umstead Hospital, Butner, Itorth 
Carolina; Director Tor Teenage Problems, YWC^, Durham, North Carolina 
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4. Maxlne Counlhan cont. 

Professional Preparation : 

1969 Duke University, Durham, North Carolina M.Ed. 
1960 University of North Carolina, Chapel Hill, North Carolina A.B. 

5. Jeff Hill 
Title ; 

Science Teacher, Lower School, Mark Twain School, MCPS 
Major Project Responsibilities ; 

Competency planning for Behavior Management Area 

Relevant Experience : 

Science Teacher,- Lower School, Mark Twain School, MCPS; Science Teacher, 
Kensington Junior High, MCPS; Director, Summer Recreation Program, 
Department of Recr^tion, Montgomery County, Maryland; Board of Directors, 
Montgomery County Jaycees, Maryland; Camp Counselor , Alexander School, 
Montgomery County, Maryland 

Professional Preparation : 

1967 Lycoming College, Williamsport, Pennsylvania B.A. \ 

6. Roslyn Inman 

Title: \ 

Staff Development Specialist, Mark Twain Teacher Education Project 

Major Project Responsibilities : 

Competency Coordinator for Human Relations and Counseling Area; Coordi- 
nator for Adolescent Life Space Experience and' Practice Teaching 
Experience; Acquisition, Preparation, and Development of Curriculum <- 
Materials; Supervisor of Public Relations and Information Dissemination 
Activities 

Relevant Experience : 

Staff Development Specialist, Mark Twain Staff Development Institute, 
1971-72, MCPS; Mental Health Associate, Office of Pupil Services, MCPS; 
President, Mental Health Associate Organization, Montgomery County, 
Maryland 

Professional Preparation : 

1972 Antioch College, Columbia, Maryland B.A. 
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Phyllis McDonald 
Title : 

Coordinator of Instructional Resources Center, Mark Twain School, MCPS 
Major Project Responsibilities ; 

Competency Coordinator ^or Curriculum Development and Implementation Area 

Relevant Experience : 

Coordinator, Instructional Resources Center, Mark Twain School; Program 
Associate, Information Center, Council for Exceptional Children; Teacher 
of Emotionally Disturbed Children, Christ Child Institute, Rockville, 
Maryland; Film Consultant, Council for Exceptional Children Film Theatre; 
Department Editor, Teaching Exceptional Children , Teacher *s Theatre - 
Column; Associate Editor, Exceptional Children Journal 

Professional Preparation : 

1972 The George Washington University, Washington, D* C. 

1966 The George Washington University, Washington, D, C. 

1964 State University of New York, Albany, New York 

1956 State University of New York, Albany, New York 

8, Judith Tarr 
Title: 

Diagnostic-Prescriptive Teacher, Mark Twain School, MCPS 

Major Project Responsibilities : 

Competency Coordinator for Psychoeducational Assessment and Prograimning 
Area 

Releva nt Experience : 

Diagnostic-Prescriptive Teacher, Mark Twain School, MCPS; Teacher, 
Catch-Up Classes, MCPS; Cooperative Teacher, Hillcrest Childr«2n*s 
Center-American University Training Program in Teaching Emotionally 
Handicapped Childreij^j Elementary School Teacher, MCPS 

Professional Preparation : 

1960 University of Michigan, Ann Arbor, Michigan B*S. 



Ed.D. 
Ed.S. 
M,A- 
A.B. 
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APPENDIX I 

Description of Instruments Devised by Competency Area Coordinators 
I. PSYCHOEDUCATIONAL ASSESSMENT 



Instrument A : Intended for assessment of P.O|»^s 1.1.1., 1.1.2., 1.1.3. A two- 
part exercise designed by staff to measure ability to construct a psychoeducatlonal 
profile and describe the pupil's level of functioning in general academic achieve- 
ment, reading, classroom behavior, and interpersonal relations. 

Part I requires the respondent to review a pupil folder of a hypothetical ^tudent 
to extract items of information relevant to six assessment areas, i.e . , gfeneral ' 
academic achievement, reading, classroom behavior (self), classroom behavior 
(others), interpersonal (peers), and interpersonal relations (adults), and to 
Judge whether or not the pupil is experiencing problems in those areas. Part 'II 
requires the respondent to describe the pupil's functioning in each area. > 

Criteria ; Part I - 5 of 6 correct; Part II - 5 of 6 correct. Against criteria 
set by a panel of experts. (This instrument was used as a pre-post measure in 
1972-73; results did not influence determination of summary evaluations of 
competencies.) 

(Perceptual) Diagnostic/Prescriptive Activity . Intended for assessment related 
to B.O. 's 1.1.2. (c-g). Designed by seminar instructor to test knowledge an., 
understanding of perceptual dysfunction, its effect on school functioning, and 
formal and info^Tnal tests used to measure perceptual dysfunction. Given the 
names of six perceptual areas, the respondent must 1) define the terms, 2) list 
for each four or more ways that dysfunction can impair school functioning, and 
3) list four or more formal and/or informal tests. Criteria: 63 points or 
more = strong; 50-62 points = adequate; and 49 or less = weak. 

Diagnostic/Prescriptive Activity . Intended to assess B.O. 's 1.1.2. (a, c-g), 
1.1.5. (d) and P.O. 1.2.3. Designed by seminar instructor to test 1) ability to 
diagnose a student's learning problem from the records included in a Mark Twain 
School student file and 2) knowledge of instructional techniques and strategies 
to meet the student's needs. From analysis of a student folder including Mark 
Twain and MCPS forms, the respondent must 1) select a perceptually related 
reading problem, 2) list ten or more related indices, 3) list. five or more 
learning disability instructional techniques and five or more classroom adjustments, 
and 4) lisj^ learning disability and* behavior management techniques for the pupil. 
Criteria ; (1 and 2): 30 points or more = strong; 15-29 points = adequate; and 
14 points or less - weak. (3 and 4): Same. Assess style: 19 + « strong; 
13-18 = adequate; and 12 points or less = weak. 

Bloom Taxonomy Assignment . Intended to assess B.O. 1.1.3. (d). , Designed to test 
1) understanding of Bloom's Categories of Thinking and 2) ability to categorize 
task demands or questions to students by the category of thinking required. 
This is cognition observation. Respondent must observe three or more subject 
classes, include 12 or more task examples, categorize tasks according to Bloom's 
scheme, and present the tally and a summary. Criterion ; Adequacy in judgment . 
of instructor. 
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(Reading) Diagnostic /Prescriptive Activity . Intended to assess B.O. 1.2.3. (f). 
Designed by seminar instructor to test 1) ability to diagnose a student's reading 
problem from a diagnostic report and select appropriate remediation and 2) knowl- 
edge of various methods and materials for teaching reading and when their use 
is appropriate. From analysis of a diagnostic report on a student with a reading 
problem, respondent must 1) select two suitable reading remediation methods and 
substantiate each with six pieces of information from the report data and 2) list 
at least seven program adjustments and substantiate each from the data. 
* Criterion: 18 points or more * strong; 10-17 points « adequate; and 9 points or 
,les8 « weak. 

I. Assignment . A graded learning activity related to P.O. 1,1.4. This is an 
intelligence observation. Respondent must observe three or more subject areas, 
indicate pup 11 \ responses, and summarize the nature of the learner (timing, pacing, 
depth, work load, etc.) Criterion : Adequacy in judgment of instructor. 



II. COUNSELING AND HUMAN RELATIONS 




Comiminications of Feelings Inquiry (COFI) and Reaction Sheet for Student -Statements . 
Intended to assess a specific ability related to B.O. 2.1.1. (a). 1) Presented 
on paper with a series of statements which convey feelings but may or may not 
describe wiiat the speaker feels, respondent discriminates descriptive from non- 
descriptive statements. 2) Presented on paper with a series of paragrapl^s 
representing student coimnunications, respondent responds to each by disctiminating 
between content and feeling in both the statement and his response. Criterion: 
90 per cent correct. 

Comprehending and Communicating Effectively . Intended to assess a specific 
ability related to B.O. 2.1.1. (b). Taped simulation/role-play of counseling 
session. Script contains five segments, each containing both content and feeling. 
After hearing each segment, respondent reflects as completely and accurately as 
possible the content and fueling of the communication. Criteria : Pass any 4 
segments » strong; pass 1, 2, and 3, or 4 and 5, or 4 or 5 plus two others » 
adequate; efCid less than adequate " weak. (Criterion for each segment is reflec- 
tion of 50 /par cent of content, 50 per cent of feeling.) 

Video-tape Simulation: Emphathy/Respect/Specificity . Intended to assess knowl- 
edge and understanding la ted to B.O.'s 2.2.1.(a-c). Group views VT and 
categorizes counselor responses for empathy or respect and for specificity. 
Level of anpathy must be specified; respect rated as positive or negative. 
Criterion : 10 or more correct identifications. ^ 

Paper/Pencil Analysis ; Self-Awareness/Self-Arceptance . Intended to assess 
knowledge and understandings related to B.O.'s 2.2.1. (d, e) • Respondent defines 
concepts, describes at least three levels of racli and relationship between them, 
and gives specific examples of bbth individt^l and group behavior to illustrate 
high and low levels of each. In addition, he does ungraded (and unread, if so 
desired) analysis of own self-awareness and self-acceptance. Criteria: 100 per 
cent « strong; 66 per cent » adequate; and 33 per cent or less weak. 
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Audio- tape Simulation; Using Empathy and Respect . Intended to assess a specific 
ability related to B.O.'s 2.2.2. (a, b). After responding to communications In 
a taped simulation of a counseling dialogue » respQnses to Helpee are rated for 
Indications of eoipathlc understanding or respect. Criterion ; 1) 70 per cent 
empathlc understanding responses at least at Level 3 (openness) ; 2) other 
responses must Indicate respect. 

Paper/ Pencil Analysis: Group Planning . Intended to. assess knowledge and under- 
standing related to B.O.'s 2.3.1. (a, b) , 2.3.2. (a), 2.3.3. (a, c) . Given a 
target group description, respondent as group leader plans for the group by 
1) stating a skill, an interpersonal, and a system objective; 2) identifies at 
least one^^behavior criterion for evaluating student progress; 3) identifies two 
specific techniques for promoting student progress; 4) selects and describes five 
leader functions; and 3) describes a logical process for identifying and resolving 
discrepancies between desired and actual student behavior. Criteria: 1) atrong « 
3 of 3; adequate « 2 of 3; and weak « 1 or less of 3. 2) Same. 3) Same. 4 J 80 
per cent correct. 5) Pass/Fail by judgment of instructor. 

* 

III. CURRICULUM DEVELOPMENT AND IMPLEMENTATION 

Constructing Flowcharts . Intended to assess knowledge and a specific ability 
related to P.O. 3.1.1. Task Required: 1) matching flowchart symbols and state- 
ments, 2) following the logic of a flowchart, 3) constructing a ifdgical flowchart 
from given symbols and statements, and 4) constructing a flowchart of an instruc- 
tlonal sequence. Criteria : 1) 85 per cent, 2) 100 per cent, 3) 100 per cent, 
and 4) 100 per cent. 

Designing Effective Instruction Post test . Intended to assess knowledge and under- 
standing related to P.O.'s 3.1.2., 3. ''.3. Task required: 1) differentiating 
objectives by types and levels, 2) £inalyzlng a task and arranging a hierarchy of 
objectives, and 3) evaluating student progress by measurement of attainment of 
objectives. Criteria : 1) 10-13 points » strong; 7-9 points adequate; and 0-6 
points « weak. 2) 24-28 * strong; 18-23 = adequate; and 0-17 « weak. 3) 20-23 - 
strong; 15-19 * adequate; and 0-14 « weak. 

Precision Teaching Posttest . Intended to assess knowledge and understanding 
related to P.O. 3.1.3. Multiple-choice questionnaire on the language, procedures^ 
and measurement techniques of Precision Teaching. Criteria : 90 or more corre^.c 
responses « strong; 60-89 « adequate; and 59 or less = weak. 

Instrument Z . Intended to assess specific abilities related to P.O.'s 3.1.2., 
3.2.2., 3.3.2. After reading a history of .a student, respondent must: 
1) formulate at least three affective objectives; 2) select appropriate curriculum 
units to attain them and indicate content to be communicated; and 3) select 
appropriate teaching strategies and give a meaningful rationale for their selec- 
tion. Criteria : 1) 100 per cent correct « strong; 67 per cent » adequate: and 
33 per cent « weak. 2) Same. 3) 83 per cent or more = strong; 33-82 per dent » 
•adequate; and less than 33 per cent » weak. 
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Bruce Joyce Strategies Demons trat Ion > Intended to assess knowledge and a 
specific ability related to P.O.'s 3. 3.1,, 3-3.2. Respondent chooses, explains, 
and demonstrates through peer-teaching a curriculum strategy to meet a stated 
educational goal. Criterion ; Adequacy by judgment of seminar instructor. 

Individual Project , intended to assess knowledge and skills related to P.O.'s 
3.1.3., 3.2a,, 3.2.2., 3,3.1., 3.4.1., 3.4.2., 3.4.4., 3.4.5. Respondent 
is required to plan, organize, and produce a curriculum package of the intern's 
choice which includes objectives, planning strategies, teaching/ learning strategies, 
resources (print and nonprint instructional materials), and evaluation techniques. 
Criteria ; Inclusion of specified components by judgment of the seminar instructor. 

IV. BEHAVIOR MANAGEMENT ' 



Application Task; Part I (Identification of Emotional Disturbance) . Intended to 
assess knowledge related to B.O. 4.1.1. (a). Given a case history of a student 
referred to Mark Twain School, respondent determines if the studeift should be 
accepted into a program for "emotionally disturbed" youth and presents rationale 
for decision. Criteria : Acceptance decision based on four or more criteria 
discussed in seminar and related to data in case history. 

Application Task; Part II (Educationa] StratPegies) . Intended to assess knowledge 
related to B.O. 4.1.3. (a). Given ca^e history of an 'emotionally disturbed" youth, 
respondent employs two different educational approaches (selecting from sensory- 
neurological, psychodynamic, interpersonal, or operant-behavior ipodif| cation) 
indicating 1) cause of youth's difficulty; 2) types of information useful for 
diagnosis; 3) goals set for each strategy; and 4) illustrative methods to« achieve 
priority goal. Criteria ; Adequate or better on four items for each strategy. 

Questionnaire No. 1 (Establishing Behavior Standards) . Graded learning activity 
related to P.O. 4.1.2. Respondent demonstrates knowledge by listing unacceptable 
behaviors in an educational setting, rationale for considering them unacceptable, 
and likely consequences both inside a^d| outside of school for student who adheres 
to the limit. Criterion ; Adequacy by judgment of seminar instructor and self. 

Questionnaira No. 2 (Establishing Behavior Standards) . Graded learning activity 
related to P.O. 4.1.2. Respondent compares Questionnaire No. 1 to a referent 
set of statements gathered from peers and instructors and reevaluates his own 
statements. Criterion ; Adequacy by jud^ent of seminar instructor and self. 

Uses of Behavior Management Strategies . |Intended to assess knowledge and under- 
standing related to B.O. 's 4.1.3. (b, c). i Respondent accurately describes the 
use of at least four of six strategies (sjtructur ing physical environment, rein- 
forcing desirable behavior, regulated permission, modelling, stating and rein- 
forcing consequences, planned ignoring), by self and others. Criterion; 4 correct. 

Video-tape, Simulation, or Observation of Behavior Management Strategies . Intended 
to assess a specific skill related to B.O. 4,1. 3. (c). Respondent demonstrates 
skill in actual classroom or simulation setting in at least four of six strategies, 
stating or clearly implying the objective of each strategy. Criterion; Four 
corzectly demonstrated. 
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Verbal Reporting (Sources of Adolescent CcrflxCt) . Graded learning activity 
related to P.O* 4.2,1. Small-group discussions to exchange views on conflicting 
sources of influence on various human needs. Criterion ; Adequacy by judgfaent 
of seminar Instructor 

Demonstration Lesson (Frustration Management^ . Intended to assess specific 
ability related to B.O.'s 4.2.2. (a~c). Respondent 1) writers an original lesson 
showing at least one strategy for coping, 2) demonstrates effective teaching by 
Implementing at least one technique from each of two major strategies for coping 
with frustration, and 3) induces frustration in the classroom and conducts a 
meauingfyl "acceptance" discussion. Criteria : 3 objectives taet « strong; 2 
objectives met .adequate; anH 1 or less met " weak. 

Written Identifications^ of Surface Management Techniques . Intended to assess 
kndwledge and understanding related to B.O. 4.3.1. (a). Respondent states tech*- 
nique and illustrates with classroom examples for at least 9 of 12 techniques 
discussed in seminar. Criterion: sCcorrect. 

Life-Space Interview Simulation . Jintended to assess a specific ability related 
to B.O. 4.3.2. (b). Given a cas^ history of a student and a critical incident 
involving him, respondent conductsaa simulation interview demonstrating 1) use 
of LSI process model to establish lieaningful communication, 2) selection and 
implementation of strategy for "clinical exploitation," and 3) development and 
statement of plan for future action with student, related to strategy selected. 
Criteria: 3 requirements met » strong; 1 and 2 met, but 3 weak « adequate; and 
1 or more unmet » weak. 

Mini-oper|int Project . Graded learning activity related to B.O. 4.3.2. (c). 
Respondent conducts and reports on a project T.nvolving a mini-operant program 
for solf \ animal, or student. Criterion: Adequacy based on judgment of seminar 
instructor. j% 

V. SYSTEMS ANALYSIS A!^D CONSULTATION 

Constructing an Educational Plan . Graded learning activity related to P.O. 5.1.1. 
ational plan is written for a studen^ chosen by intern acting as SET and using 
1 given, including observation of student and teacher, teaching strategies 
ry, curriculum adjustments, specific activities, grouping practices, physical 
setting, and evaluation technique. Criterion : Adequate inclusion of elements of 
model based on judgment of instructor. 

Plannii^g^a School- Family Conference . Intended to assess an ability related to 
B.O. 5.1.3. (a). Given a student's folder and some additicyial information, 
respondent writes 1) assessment of interacting system^; 2) plan for a school- 
family conference which includes who will be present and why, questions to csk . 
ot those present and of self, and minimal expectations for future; and 3) follow- 
up. Criteria ; Adequacy on judgment of seminar instructor (completeness and logic) 

Class Exercise: Role Expectations and Hindrances . Graded learning activity - 
related to P.O. 5.2,1. Given system roles (Principal, Teacher, Counselor) and 
student case study, role play of conference. Criterion: Articulation of under- 
standing of influence of system role expectations on conference outcomes in class 
discussion. ^ ^ 
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Class Exercise: Values and Norms - Graded learning activity related to. P.O. 5.1.1. 
^ 5 TT laLe as aho^k. fa lt^n; Articulation In class discussion of under- 
^ J'Ag'oi dSJe^enS betwe^^-^ole;-exp^ personal vie. of rol.. 

■ U«P of the Consultative Modfel . Intended to assess a ^P^^^J^^f i^"y,";f '° 
io 5 3 3 (a). Given a stude nt's referral form, respondent plays role of SRT 
I; ;o^e;Le with teacher, using consultative model as presented in s-inar. 
"iterlon ; Adequacy determined by judgment of seminar instructor (Inclusion, of 
elements of model). 

UnderstandlhR the Conflict Cycle . Intended to assess kno^^ledge and understanding 
'S?at^ to B^O S.2.2.(a). Given a report.of a stressful si^^lon, respondent 
analyzes It acfcordlng to t'he model of a conflict cycle, plottln^the stress 
".yclL showlng^understandlng of a single stress cycle and the interaction of two 
. stress cycles! and indicating where to intervene. Crit.erloa: Adequacy depends 
on the judgment of seminar instructor. 

Claw Assignment . Graded learning activity related to P.O. 5.2.3. Small groups 
ch^se one q£ the problems typical of those facing SRT's and using a SA model, 
make an informal presentation in class. - Criteri on; Adequacy depends on the 

• jt^gment of seminar instructor. ' - 

• School SysteiL: Analysis . Graded lei-rning activity related to P.O. 5; 2.1. D 
ing a diagnostic model of school in which Interf) was doing practlciaii 
with a*lminlstratlon. teachere, students, /--tc; observation at formal 'P^^tings, 
t.aas meetings, classroom sessions and informal meetings in cafeteria, teachers 
rooms, etc. Criteria: 1) description," 2) fullness of description, 3) accuracy 
as validated by others at site, and 4) analysis of iLiplications of facts on 

■ judgment of others at «ame practlcum slt.^. / 
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SuBsmary of Grades' on Techniques for Assessment of 
Intern Performance in Seminars 

(See Appendix I for description of instruments.) 



A 88ef*pgept Technique 



Related 
P. 0." 



I. Psytehoeducaticial Assessment 
^a nd Flrograaming ' 
•.' • 

Perceptual Diagnostic/ 

PrABerlptive Activity ' , 



1.1.2. 



Diagnostic/Prescriptive Activity 1.1.2. 

1 • 1 • 3 • 
1.2.3. 



Bloom Taxoiwoy Assignment 



1.1.3.. 



G rade^ 



Incomplete/ 
Strong Adequate Weak ' Absent 



2 

N»> 2 

2 



5 
4 
6 



1 

2 
0 



0 

0 ' 
0 ' 



fte^H^^ Dlagaostic/ 
Ptescriptive Activity 



1.2.2. 
1.2.3. 



I.Q. ABglfgnnfeBt 



1.1.4. 



II. " 'HuB»an Relation* and 
5 Counseling 

COFI and Reaction Sheet 



2.1.1. 



Cooprehendlng and Coiomunlcatlng 
Effectively .2.1.1. 



VT Simulation: 
Empathy 
Respect* 
Specificity 



2 

1' 



6 
6 



0 

0 



0 
0 



■I 



2.2.1. 
2.2.1. 
2 • 2 • 1 « 



Paper /Pencil Analysis: 
Seif-Awartsness 
j;e If -Acceptance 

Audllo-T«pe Simulation: 

Ufiit^g Em pathy an d Respect 



1 
1 
6 



0 

0 
0 




2.2,2, 



Group Planning: 

Stating Objectives ' TT' 

Identifying Bchnvlpr Criteria 2.3.3. 
Techniques 2.3.2. 
Leader Functions 2.3.3. 
Resolving Disc repancies 2.3.3., 



.5 r 



4 
4 
2 
0 
3 



4 
4 
6 

8. 
3 



0 
0 
0 

0 
0 



0 
0 
0 
0 
2 



EMC 



APPENDIX J cont. 



Assyssttent Technique 



Grade* 



Related 
P. 0. 



III. CttrrlculiM Pevelopiiiea^f^ and ^ 
iBplettcntatlon 

Flowcharting: 

Match Syobola and Statenents 2. 1.1. 
Follow Logic -3.1.1. 
Itoe Given Elenents 3.1.1. 
Construct Ingtructlonal Chart 3.1 A. 



Designing Effective Instruction 
Posttest: 

Dlffereqtlate Objectives 3.1.2. 

Task Analysis/Hierarchy 3.1.2. 
Evaluatl^ of Sttident , 

Progress ^ 3.1.3. 



Incoiaplete/ 
Strong Adequate Weak Absent 





s. 






0 


>8 


. 0 


0 


0 


8 


0 


0 


0 


"8 


0 


.0 


0 


8 


b 


0 



0 
0 



8 
8 



0 
0 



0 
0 



Precision Teaching Posttest 



3.1.3. 



Instruaent--Z: 

Foraulate Objectives -3.1.2. 

Selefct Unit 3.2.3.' 

Select Strategies /Rationale 3.3.1. 



3 
4 
5 



Bruce JflfSrce Sj,rategies 
Demons t r atit;^ 

Plan f 
, laplenent 



3.3.1. 
3.3.2. 



0 
0 



Ixdllvldual Project: 
i^iq^slon I-C 
Unenslon I-D 
Dimension I-B 
Dloenslon III^ . 
Dimension lie 

' Dimension I-E 
Dimension I~F _ 



3.2.1. 
3.2.2. 
3.3.1. 
3.4.2. 
3.4.4. 
3.4.5. 
3.1j3. 



6 
5 
6 
6 
6 
6 
6 



Demonstration of A-V Equipment 3.4.3. 



5 
4 
3 



0 
0 
0 



8 
8 



0 
0 



2 
3 
2 
2 
2 
2 
2 



0 

7 

0 
0 
0 
0 
0 
0 



0 
0 

0 



0 
0 



\ 

0 
0 
0 
0 



IV. Behavior Manafjtement 

Application Task: 
Part, I 
Part II 



t4.1.1. 
4.1.3. 
4r^'l.2. 



0 
1 



8 
7 



0 
0 



0 

0 



Questionnaire #1 



Questionnaire #2 



4.1.2. 



*0 



/ 



/ 
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Assessment Technique 



Grade 

^Related k o Z Incomplete/ 
P, 0, ' Strong Adequate Weak Absent 



IV. ' Behavior Management coht 

Written Identifications of 
Strategies ^ ^ 



4a. 3. 



0 



VT, Simulation or Observation of 
Strategies ^ U.l*3. 



VCTbal Report on Adolescent 
Conflict ' 



4.2.1. 



Demons't*ration Lesson: ' 
Frustration Mana^^ement 



4.2.2. 



Written I. D*: *' 

Surface Manaf^ement Techniques 4.3.1. 



Life Space Interview Simulation 4.3.2. 



Minl-Operant Conditioning 
Project 

V. System^ Analysis and 
Consultation 

Constructing an' Educational 
Plan ^ 



4.3.^>^ 
— ii 



5.1.1. 



Planning Sihool/Family 



0 . 



Conference: ^ 

Assess 5.1. 1« 
Plan 5.1.2. 
Implement 5.1.3* 


5 3 0 0 

3 5 0 0 , 

3 4 1 "0 


Class Exercise: » 

Role Eigiectations 5.2.1. 
Values and Norms ^ 5.2.1. 


0 ,8 ' 0 0 
0 8 0 0 


Use of Consultative Model: 

Gather Data 5.3.1. 
Implement , 5.3. 3. 


0 8 0 0 ' 
0 8 0 • 0 


>• ♦» 
Understanding 'Conflict Cycle 5.2.2. 


0 7 1 0^ 


Class Assignment ^ 5.2.3. — 


0 8 0 . 0 


School System Analysis 5.2.1. 


V 6 0 ° 1 


riiiaar'Anm Observation '5i3.2. 


0 -8 0 O ' 0 ^ 





APPENDIX K 

D«8crlptlon of Instruments Us^ to Meksure Changes In Attitudes and Values 

The Speclall»ed Proficiencies for Working w i th Exceptional Children Questionnair e 
Slcki^lgeS) is a self-rating s cale of 110 items of specialized Job skills or 
•c^p.t«cle, for teachers who «ork with exceptional children. The instrument 
was used as part of the study puallf ications and Preparation of Teachers of 
^.aptlonal Children , undertaken by the United States Department of Health, 
M^catlon, and WUfar e. A modified version (Tompkins, 1971) was designed to 
elicit opinions as to the inportance^of the compettocles to an Individual s job 
assignment as well as^s opinions of his ability on those competencies in the - 
follSing areas: knowing the child, curriculum materials and method^ testing 
and psycho^ducatlonal assessment,- counseling, and behavior managemen^ the teacher 
as a professional teim worker, parent and public relations, and teaeJher as a 
person. It was used to measure changes in the opinions of trainees JfL,^° '^^^^ 
Importance of specified competencies and their confidence In their abilities to 
perform specified tasks in working with exceptional children after exposure to 
the program. _ 

The Teacher Practices Questionnaire (Sorenson, 1963) consists of 30 problem 
situations typical of those encountered by teachers in their dally routines. 
For each problem, four alternative solutions were present^ representing the 
following role dimensions: counselor, disciplinarian, in^rjatlon giver, 
motivator, and referrer. The Instrument is bagfad on the work of Ryann (19,60). 
It was used to measure changes In trainees^rcept^on of their roles in meeting 
typt(^l problem situations. ' r 

The P ersonal Orlentat'ion Inventory (Shostrum, 1966) consists of 150 tvfo-choice 
comparative value judgment items and purports to tap self-actualization, a 
concept used by such writers as Maslow and Rogers. There are four major scales 
and ten' subscales. It was used to measure changes in the opinions of trainees 
about their abilities to function as self-actualizing individuals with autonomy 
and interdependency. 

The Fundamental Interpersonal Relations Orie ntation-Behavior (Schu).tz, 1962) 
seeks to measure "how an individual acts in interper^ional relations. It is 
designed not only to measure individual characteristics but also to assess 
relationships between people, sucras compatibility." It att;empts to evaluate> 
behavior on three "fundamental interpersonal dimensions," inclusion, control, . 
and affection. It was used to measure changes in trainees' perception of tYi^t 
sensitivity, personal awareness, and lygtion skills in social situations. 

^ The* Minnesota Teacher Attitude InventorW Coek? 1951) consists of 150 attitude 
statements designed to pre^dict how well a teacher will get along with pjipils in 
^terpersonal relationships and indirectly how well satisfied a teacher will be 
with teaching as a vocation. It assumes that a teacher ranking at the high end 
of the scale will be able to maintain harmonious Relationships with his pupils 
and that the relationships will be characterized by mutual ejection and 
sympathetic understanding. It waa used to measure changes in. trainees opinions 
of their ability to Interact with students with harmony,' flexibility, and 
mutual understanding. 
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The P rofile of Organizational Characteristics Is a questionnaire consisting. of 
49 Llkert-type Items addressing eight organisational variables (see Appenjlx L.) 
Four levels of organizational behavior are Identified on a continuous scale: . 
•tploltlve authoritative, benevolent authoritative, consultative, and patticipative. 
It Is designed to determine respondent preferences in the organizational character- 
istics of his school. ' This Instrument Is a modified version of the one developed 
by Renls Xlkert (1967). The wording of item& was revised to .remove the -business 
tone" and to enable educators to respond to their setting. Two items, 36 and 51, 
were dropped from Likert's version. It was used to measure changes in trainees, 
preference for the democratic organization of a school. 

The Probleiit Behavior Analysis (Walker, 1967) is a list of 124 Items' whleti represent 
overt actions -observed in the classroom. Ratings are obtained on 1) the frequency 
'of occurrence of the brftavlor afltictpated in the classroom and 2) the personal - 
reaetloa> (a^tent of feeling disturbed) co the behavior. (The checklist was 
devised originally to compare rater responses in the Identif Itation of emotionally 
disturbed children.) It was used to measure changes in trainees' estimates of • 
the frequency of problem behavtocr in tha classroom and the degree of discomfort 
caused by the behavior of problem children. ^ , 

The Self-Evaluation of Competencies is tha rating by participants of their 
V abilities in the same 15 subcompetencies , on the ^ame T-point scale, which ar^ 
the learning goals of the program (see Appendix D) . It was used to' measure 
changes in trainees' opinions of their, competencies after exposure to the program. 
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APPENDIX L 



1 



Suwnary of Medians and T Values of Wilcoxon Matched-Pairs 
Signed-tlanks Test on Pre- and Postintemship 
Test Battery i ^ 




Specialized Proficiencies for Working with 
Exceptional Children Questionnaire (SPQ) 

A. Knowing the Child - importance 

- confidence 



B. Curriculum Material and Methods 

- importance 

- confidence 



•urri 

t 



^ C. Testing and Psychoedudational 
Asisessment 

- iiaportance \ 
.^•^ confiderxe 

D. Cqunseling and Beh&vicr Management 

- importance 

- confidence 

E. Teacher "as a Professional Team , 
Worker ^ - importance 

* - confided^ 

F. Parent and Public Relations 

- importance 

- confidence 



G. Teacher as a Person 

- con 



- ifiportanc 
?ide 



nc^ 



5.62 
3.15 



5.36 
2.94 



ay 

4.6i 
3.04 



.5.26 
2.79 



5.04 
2.91 



4.67 
3.00 



6.69 
4.19 



5.77 
4.12 



5.83 
3.92 



5.34 
3.96 



5.84 
4.27 



5.82 
4.05 



4.17 
3.83 



6.44 
4.63 



Scale: Range: 1-7 for Importance, 1-5 -fof Confidence. 



Teacher Practices Questionnaire (TPQ) 

A. Information Giver 

B. Counselor 

C. . Disciplinarian 

D. Motivator 

E. Referrer 



2.64 
1.32 
4.33 
2.2S 
3.55 



+0.15 
+0.97 



+0.47 
+0.98 



+0.73 
+0.92 



+0.58 
+1.48 



+0.98 
+1.14 



r0.50 
+0.83 



-0.25 
+0.44 



2.84 
a. 71 
4.20 
2.15 
3.90 



+0.20 
+0.39 
-0.13 
-0.O5 
+0.35 



Scale: Range: 1-5; Scores inversely related to preference. 



15 
0 



8 
0 



10 
0 



6 
0 



5.5 



14.5 
8.5 

6w6 
5 
0 



N.S. 
p<.05 



N.S. 

p<»01 



^N.S. 
p<.01 



N.S. 

p<.01 



N.S. 
p <.02 



N.S. 
N.S. 



N^S. 
P <.01 
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/ 



Instrunent 



Personal Orientation Inventory (POI) 

. A. Time Incompetent 

B. Time Competent 

C. Other Directed 
/ D. Inner Directed 

E. Self -Actualizing Value/ 

1?. Exlstentlallty 

o. Feeling Reactlvely 
H. Spontaneity s 
^ I. Self -Regard 
J. Sfelf-Acceptance 
K. Nature of Man, Sons t ruction 



L. Synergy 



M. Acceptance of Aggression 
N. Capacity for Intimate Contfact 



Median 



Prg ^Post Dlff. B T Score 



3.0 
20/0 
31.5 
95.0 
23.0 
22.5 
\7.0 

14.0 



lyTo 



13". 0 

i. 

.18. 
20. 



3.0 
19.0 
18.5 
100.5 
23.0 
24.5 
18.5 
14.5 
'14.0 
19.5 
12T0 
8.0 
20.6 
22.5 



-1.0 
■13.0 
+5.5 

. 2.6 

+1,5 

+0.5 

-0.3 

+2.5 

-1.0 
_ Ik 

+1.5 
+2.0 




Fundan»ental Intarp.ersonal Relation s Orientation - Beiavlor (mo-B?; 



A. Inclusion Expected 

B. Inclusion Wanted 

C. Control Expected 

D. Control Wanted 

E. Affection Expected 

F. Affection Wanted 



5.0 
3.5 
3.0 
3.5 
4.5 
6.0| 



4.5 
1.5 
4.0 
3.5 
3.5 
5.0 



-0.5 
-2.0 
+1.0 

-1.0 
-1.0 



2 ' 
10 
8 

2.5 

-8 
5^5 
8 

6.5 
•2 

. 11 

10.5 



5 
6 

5.5 

9 

1.5 
1.5 



S ^n l flcance 



■ N.S. 

N.S. 
p«.05 

. N,S. 
N.S. 
N.S. 
N.S. 
N.S. 
N.S. 
' N.S. 
N.S. 
NfS. 
N.S. 
N.S. 



N.S. 
N.S. 
N.S. 
N.S. 
N.S. 
N.S;^ 
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1 




It 




■ _ • 


Median 




significance 


_» Instrument ' . _, 


Ae 


Post 


> A 


T Score 


Minnesota Teacher Attitude -Inventory (MTAI) 


71. y 


7^.0 


+2.5 


11..5 


N.S. 


_ r- 


• 










A. Leadership 


3.18 


3.14 


-0.04 


14 


)).S. 


Motivation 


3.10 


3.41 


+0.31 


10 


N.S. 


^ Coomiunicati^n 


3.28 


3.29 


+0.01 


' 17 


N.S. 


Interaction 


3.29 


3.49 


+0.20 


9 


N.S. 


Decision 


3.19 


3.62 


+0.43 


9 


N.S. 


Goal Setting 


3.43 


3.28 


-0.15 


17 


1 

N.S. 


Supervisory ^ 


J. 17 


J* z / 




13 


N.S. ^ 


Performance 


3.78 


3. 00 


-0. /o 


15.5 


■ N.S. 


bcaie • Kange • u-*^ 










— — r- 


Instrument A ^ 












Part I (Abstracting Information) 


5.0 


'4.5 


-0.5 


6.5 


N.S. 


Part II (Describing Learner) 


4.5 

1 


5.0 


+6.5 


3 


N.S. I 
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Instrmient 



-^ feob lea behavior Analysis (PBA) 

A. Social Manifestations 
« 

1. Oppositional Behavior (20 , items) 



2. * ' Overt Aggressive Behavior 

(26 items) 

3. Deviations in Social Development 

(18 items) 

B. • De^lopment Manifestations 

4. Neuro-phys-Motor (15 items) 

5. - Signs of Restricted Functioning 

(18 items) 



6. Failure to Follow-through 
^ (9 items) 

C. Linguistic Manifestations 

7. Verbal (9^ items) 

8. Self-criticism (9 Items) 



Scale: 



0- 5 ^'requency 

1- 5 Reaction 



<? 



F 
R 

F 
R 

F 
R 



F 
R 

•F 
R 

F 
R 



F 
R 



Pre Post 



2.01 
2.23 

1.75 
2.58 

2.14 
2.19 



1.97 
1.44 

2.00- 
■ 1.53 

1.78 
1.89 



2.11 
1.50 

2.44 
i:67 



2.88 
2.23 

2.37 
3.02 

3.20 
2.20 



Dlff. 



+0.87 



.+0.62 
+0.44 

+1.06 

+0.01 



2.86 I +0.89 
1.901+0.46 

2.37 H +0.37 
1.47 H -0.06 

2.78 R +1.00 
1.78 I -0.11 



2.39 
1.78 

3.28 
1.73 



+0.28 
+0.28 

+0.78 
+0.06 



T Score 



5 
16 

. 5 
11 

5 

15.5 



7.5 

0 

10 
6 

7.5 
5 



12 " 
6 

4 

11 



Significance 



N.S. 
N.S. 

N.S. 

N.S. " 
N.S. 



n:s. 

P-.02 

N.S. 
N.S. 

N.S. 
N.S. 



N.S. 
N.S. 

. P-.05 
N.S. 
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1 - 1^ . ^ 


KedUnL 




T Score 


Sifmificanca 


lostruaent >' 


Pre 


Post 




Self->evAluatiOQ of Competencies 
General Ef fectiven€i88 


6.0 


7.5 




0 


%t>-.05 


^ » I, Psychoeducationamsaessment 


3.5 


7.0 




0 


P«101 


1.1 Profile 

1.2 Planning 

1.3 Consultattbn 


4.0 
4.5 
5.0 


7.0 
7.0 
• 8.0 


+2.5 
+3.0 


0 

, 1 

0 


P-.Ol 
p<.02 
P-.Ol 


II. Human Relations and Counselinf^ 


5.0 


7.5 




0 


P-.02 


2.1 Comprejj^nsion and Conmunication 

2.2 Interaction ^ 

2.3 Serve as Resource - 


6.0 
6.5 
6.0 


• 

7.5 . 
8.25 
8.0 


+1.75 
+2.0 


0 
0 


p«.02 

P-.02 


*III. Curriculum Development 


4 5 


6.5 


"+2.0 


0 


D-.Ol 


3.1 Orgknize and Manage 

3.2 Form Objectives 

3.3 Develop and Select Curriculum 

3.4 Plan Strategies and Activities 

3.5 Individualize 

3.6 Evaluate 


' 5.25 
4.5 
4,J5 
3.5 
6.0 
5.25 


• 

6.75 
7.0 
7.0 
. 6.75 
7.0 
7.0 


-+1.5 

+2.25 
+2:25 
+1.0 
+2.25 


f 

0 ^ 

0 

0 
0 

i.5 , 

0 


p-.Ol ' 

p-.ai 

p-.Dl 

p-.Ol,* * 
. 'p<.05 
P-vOl 


IV. Behavior Management 

4.1 Establish Limits 

4.2 Identify Conflict 

^ 4.3 Teacher Intervention 


5.0 
'5.0 
' 5.0 
4.0 


7.25 

7.0 

8.0 


. +2.25 

' 4-9 0 
' ~4 . u 

■•^3.0 
+3.25 


0 • 
0 

0 

0 


'. ' P-,.0f\ 
P-.O^ - 
P-.Ol 
P-.Ol 


V. Systems Analysis ' 


3.0 


7.5 


Xd-4.4> 


. 0 


P-.05 


5.1 Concepts 

5.2 Use 

5.3 Consultation 


if 5.0 
^3.5 
5.0 


7.5 
7.5 
7.25 


+2.5. 
+4.0 
» +2.25 


1.5 

1 • 


^ P<.02 
, P*-.-01 
P<.05 



•Subcompetencie. as stated In August. 1972; Revised StateMnta In Appendixes. 
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Form Used to Evaluate Instruments Used ^or Assessing 
Intern Competence and Attitude Change 



SO 



MEANTESt 
EVALUATIC?N FORM 



0 



Te«tNuM 

Evaluation Cntvna 



Rat^r. 



1 M«Mur««cnt Valtditicft 
a ConttifyHl Con^tnict 



b Cottcup^nt and Prwitctivy ^ 



2, ExamirKe* AppropnaWheM 
a Coinprth^nMon; content 



tiwttuctiona 



b. Format 

I Viaual pf inapt— 



2. Quality o< iHuttrationi jpyinO 



3 Ttm* and pacing 



c Rgcordwf a«i»wer» \ 



T Xdroinistratjvc Utabilt<y 
a Adminitt ration ' 
i T««t adminftfation 

2. rratning ot admtntttfatory 



3 Admuiistration 



c Interprvtatioir' 
1, Norma 
a Norm range 



b Scof* interpretation 



c Score cunver«}on 



d Norm group> 



d Score Int* ureter 



\ ^ e Can Decwona ge Made 



0 (only in name) 



0(n 



» reported) 



-2(af*w) 



(Vfiry little) 



irtapptopfUte 
0 



4 (Hime) 



2 (tome) *' 



doubtful 



0 (complicated) 



0 (notgo&a) 



6 ({air 



3 (ixHeniHigh) 



potoiMy appropriate 



a (bMtavaiUMel 



4 (conaidcvabia 



prubably appropriate 

3 



i (prob^y good) 



1 iheipfuh 



Olbad) 



0 (coftipitcated) 



0 (individual) 



I 



2(oyti 



i (appropriate l<Mrbr«>9< 



1 (sundardi 



1 (ftmall grouiM) 



2( 



til 



0 (p»ych<itnelri«0* 



0 (43 • minute*) 



0 (MibKctivej^ 



,1 (42minut««or I 



1 (diAcult) 



2( 



, 0 (reatrictet!) 



0 (uncommon. ab<tru«e) 



0 ( complicated) | 
0 ( local, outdated, or poony aampled^ 



I (broad) 



1 (common, 



I dimple) 



2 it 



0 (^ycbcHnetrtft) 



0 doubtful 



4 Normed Technical Eaee^ence 
a StabUity , 



b Internal ConB»tency 



c Alternatr fnnm 



a B<i>bcabtlity ' 

e fUnge ol Coverage 



t ScoreiT 



not reported or leM than 70 
0 



1 po(i>i&!e 



TOto do 
1 



1 (national, well • 



1 (tdioolMsfl) 



2 probable 



^to 90 
3 



3 y#» 



" "O no mformauon | i fl oor or c eiling reached J 2 adequate ^ 

Op>>orly graduated and ..ncommon | 1 p.>.>rlv graduated «.r u.ic<munon | 2wellg»^ 



ERLC 
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Form Used to Evaluati Instruaents Used for Assessing 
Intern Competence- and Attitude Change 



4^ 



Evilustion Cntena 

I M«Mur«m«ntVft{Mlit»cft 
« Coptrwt and Contmct 

b C oyurtent and Ptedicfav* 

[ 2 Examine* Appropnatenet^ 

^ Comprthttmoa content 

, imtnictiona 



Fona. 





0 (only in nanir) 


2 (a f«w> ' 


0 inonereportwi) 


1 (very MUe) 

1 A^tUttt' 



b Format 

I Viaual pnncipto 



Qual ity of lUmtrationi ipnnt) 
Time and pacing 



3 Admiftutralive ir«abiUty 
a. Admimitration 
I Teat adminwtration 
2'lt|bintng <^ adrotntstraton 



^ AdnnnM tration 
b ScoHnu 



c. Interpretation 
I Norma, 
a Norm range 



b Score i» terpretation 



0 (complicated) 
0 (not soo4> 



0<bad) 

0 (coanrficated) 



0 (indi vidual) 

0 (p»ychomrtn«t) 
0 (43 ' m^utes) 



* 0 (subjective) 



0 (restricted) 



Rater. 



Date. 



Ratine (circle one mtfebrr tn e«cb row ) 



4 (9droe) 
2 (lome) 



6 (fair job) 
3 (Rot enough) 



8 (be«tavaala6le) | 
4 (conwderable) 



^^b^y appropriate probaNv appropriate 

2 J L 

3 



10 (hit nail on 
the head) 

> (exhaustive) 

euctly rtght 
4 




1 ( probably good) 

I »he!pf«<)^ 

I 



2 (omaUndinganfa) 
2 (emcellent) ^ 



1 t«ppn*pnate (oi'bmad range) 



1 (^tandarii^ 
I <«nait frouq»> 



♦ 2 (eapecially « 

2 (lar ge groups) 
1 (school ttall) 



i jETotal "1 | 



I (42 minutes or lew) 



1 (diAcult) 



2 (sunpte) 



0 (unctMnrnJ^. abatrme) 



1 tbcoad) 



I (cwnmon. wmpje) 



c Score convemon 
d. Normgpoupa 
d Score Interpreter 



e Can Pcciaiona Be Made 
4 Normed Technical Excellence 
I. StabUity t 



b Internal Consistency 
c Al ternate form ^ 
d Rgplirab ility 
. e Range of Coverage 
t acores 



0 (complicated) 

0 (local, outdated- or poof i> >atepled) 

0 ( psychoroetnst) ^ 

1 pOMible 



I (simple) 



0 doubtful 

not ayported or less than 70 
0 



70to 80 
1 



2 (clear, tab les) 
1 ( natio nal, well sampled) 
I <«cbootsU(f) 



2 probable 

aOt(\ 90 
2 



3 yes - charU and graphs 



904 
3 



3 more han adequate 



0 no " I »<»oororc..l.ng reached j ^ ^^""^1 - 2 well graduated am i .t«Klard 

I oootlv graduated or unr«min»>n | ^ gra nuaien v f» 



0 D«to rlv graduated and uncommon 
6 



Grade 



1 [n Total ^ 
|Gmde j\ 



1 



ed froA CSE 
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